-- Logs begin at Wed 2022-10-05 19:42:19 UTC, end at Wed 2022-10-05 20:42:50 UTC. -- Oct 05 20:13:23.000044 dv-cinder-801522-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 20:13:23.008852 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 20:13:23 2022] *** Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: nodename: dv-cinder-801522-12-iscsi Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: machine: x86_64 Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: clock source: unix Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: pcre jit disabled Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: detected number of CPU cores: 4 Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: current working directory: / Oct 05 20:13:23.010848 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: detected binary path: /usr/bin/uwsgi-core Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: your processes number limit is 47680 Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: your memory page size is 4096 bytes Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: detected max file descriptor number: 2048 Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: lock engine: pthread robust mutexes Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: thunder lock: enabled Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 20:13:23.011506 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 20:13:23.050347 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: Python main interpreter initialized at 0x562e297f39c0 Oct 05 20:13:23.050347 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: python threads support enabled Oct 05 20:13:23.050347 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: your server socket listen backlog is limited to 100 connections Oct 05 20:13:23.050347 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: your mercy for graceful operations on workers is 90 seconds Oct 05 20:13:23.050683 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 20:13:23.050761 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: *** Operational MODE: preforking *** Oct 05 20:13:23.051006 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: *** uWSGI is running in multiple interpreter mode *** Oct 05 20:13:23.051006 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: spawned uWSGI master process (pid: 105349) Oct 05 20:13:23.051195 dv-cinder-801522-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 05 20:13:23.052997 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: spawned uWSGI worker 1 (pid: 105350, cores: 1) Oct 05 20:13:23.052997 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: spawned uWSGI worker 2 (pid: 105351, cores: 1) Oct 05 20:13:23.052997 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 20:13:23.706370 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 20:13:23.710474 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 20:13:24.781099 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:13:24.781099 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: from cryptography.utils import int_from_bytes Oct 05 20:13:24.781726 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:13:24.781726 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: from cryptography.utils import int_from_bytes Oct 05 20:13:24.781996 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:13:24.781996 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: from cryptography.utils import int_from_bytes Oct 05 20:13:24.782451 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:13:24.782451 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: from cryptography.utils import int_from_bytes Oct 05 20:13:27.254009 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 20:13:27.254528 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 20:13:27.254697 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 20:13:27.255061 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 20:13:27.255313 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 20:13:27.255695 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.256015 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.256120 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 20:13:27.256502 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.256586 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 20:13:27.256662 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.256898 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 20:13:27.256998 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.257234 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.257328 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 20:13:27.257506 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 20:13:27.257616 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.257870 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.257973 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.258194 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.258287 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.258452 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.258538 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.258764 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.258863 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.259084 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-12-iscsi {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.259170 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.259400 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.259492 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.259704 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.259796 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260032 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260118 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260346 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260438 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260640 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260733 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.260954 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.261046 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.261256 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.261341 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-12-iscsi {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.261607 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.261773 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.261918 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.262907 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263041 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263172 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263298 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263426 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263555 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263677 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263796 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.263929 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264179 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264301 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264433 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264556 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264685 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264801 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.264922 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265041 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265162 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265294 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265407 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-12-iscsi {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265552 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265676 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.265888 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266021 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266143 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266262 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266391 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266544 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266680 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.266865 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267006 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267158 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267298 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-12-iscsi {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267492 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267600 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267794 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.267914 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.268098 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.268229 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.268417 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.268640 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.268733 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.268951 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.269043 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.269260 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.269342 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.269638 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.269755 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.269943 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270039 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270248 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270338 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270566 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270664 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270866 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.270954 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.271165 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.271255 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.271413 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.271498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.271715 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.271807 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272029 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272114 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272347 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272503 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272651 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272801 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.272953 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.273101 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.273253 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.273462 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.273637 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.273778 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274149 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274298 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274434 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274568 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274710 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274846 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.274990 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275137 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275293 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275442 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275442 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275702 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275702 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.275967 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276114 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276250 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276384 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276518 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276663 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276798 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.276943 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.277077 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.277217 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.277450 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.277617 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.277755 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.277900 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278044 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278044 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278308 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278308 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278570 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278725 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.278872 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279008 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279156 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279293 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279427 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279560 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279706 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279851 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.279998 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280145 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280290 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280425 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280576 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280711 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280854 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.280989 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.281123 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.281258 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.281399 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.281581 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.281759 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.281898 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282034 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282175 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282317 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282470 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282607 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282741 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.282875 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283009 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283153 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283297 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283432 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283567 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.283876 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284018 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284161 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284313 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284485 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284633 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284768 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.284920 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285061 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285196 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285331 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285472 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285675 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285824 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.285961 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286107 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286250 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286386 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286521 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286668 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286804 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.286938 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.287079 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.287214 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.287350 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.287577 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.287721 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.287864 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288020 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288163 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288307 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288455 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288598 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288733 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.288875 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289011 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289144 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289287 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289423 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289586 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289729 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.289875 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290010 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290226 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290371 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290516 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290652 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290800 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.290937 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.291080 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.291722 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.291861 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.291995 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292129 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292283 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292426 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292561 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292696 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292837 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.292972 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.293114 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.293250 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.293412 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.293602 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.293747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.293883 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294057 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294213 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294348 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294483 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294672 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294816 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.294960 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295114 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295251 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295391 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295526 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295660 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295805 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.295940 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.296121 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.296267 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.296426 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.296584 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.296729 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.296954 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.297095 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.297238 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.297374 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.297544 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.297697 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.297834 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.297988 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.298124 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.298271 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.298419 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.298554 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.298689 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.298823 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.298958 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.299102 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.299237 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.299406 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.299550 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.299711 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.299864 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.300032 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:13:27.300183 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.300367 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.300512 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.300658 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.300801 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.300968 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.301114 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.301256 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.301392 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.301593 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.301767 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.301915 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302053 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302218 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302363 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302532 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302686 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302845 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.302997 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.303159 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.303304 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.303448 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.303584 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.303743 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.303887 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304054 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304207 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304353 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304497 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304658 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304809 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.304993 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.305137 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.305293 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.305438 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.305633 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.305790 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.305954 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.306106 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.306246 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.306395 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.306562 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.306705 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.306965 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.307596 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.307766 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.307918 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.308078 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.308244 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.308404 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.308547 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.308696 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.308833 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309013 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309157 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309322 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309474 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309680 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309819 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.309954 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310090 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310235 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310371 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310524 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310669 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310831 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.310983 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.311142 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.311286 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.311473 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.311618 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.311783 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.311927 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.312102 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.312270 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.312486 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.312625 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.312767 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.312903 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313052 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313197 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313340 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313482 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313659 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313805 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.313952 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.314095 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.314242 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.314378 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.314513 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.314649 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.314784 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.315182 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.315327 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.315476 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.315617 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.315754 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.315890 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316033 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316187 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316332 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316469 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316611 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316795 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.316941 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317086 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317229 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317371 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317506 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317720 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317859 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.317996 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.318141 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.318277 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.318413 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.318562 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.318699 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.318858 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319003 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319161 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319304 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319478 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319631 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319776 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.319920 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.320076 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.320225 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.320362 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.320497 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.320639 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.320782 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.321161 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.321312 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.321450 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.321630 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.321769 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.321905 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322048 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322202 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322339 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322481 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322617 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322752 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.322895 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323045 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323181 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323316 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323458 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323600 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323744 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.323895 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324033 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324167 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324309 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324445 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324589 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324735 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.324877 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325012 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325159 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325296 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325439 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325600 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325748 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.325907 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.326053 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.326221 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.326383 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.326556 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.326702 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.326889 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327041 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327187 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327322 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327465 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327602 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327747 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.327883 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328031 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328167 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328310 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328446 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328606 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328750 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.328895 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329032 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329189 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329342 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329479 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329671 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329821 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.329959 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.330102 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.330238 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.330398 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.330551 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.330732 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.330876 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331044 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331194 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331352 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331520 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331658 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331791 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.331959 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.332103 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.332261 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.332412 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.332550 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.332684 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.332853 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333003 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333151 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333295 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333442 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333609 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333772 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.333916 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.334064 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.334201 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.334378 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.334523 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.334683 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.334827 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335002 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335147 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335308 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335463 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335623 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335773 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.335921 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.336059 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.336201 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.336336 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.336533 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.336678 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.336855 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337010 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337155 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337290 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337468 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337673 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337821 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.337958 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.338612 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.338758 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.338922 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339076 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339213 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339354 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339520 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339663 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339824 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.339990 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.340139 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.340275 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.340410 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.340551 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.340722 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.340951 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341090 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341232 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341368 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341534 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341681 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341830 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.341986 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342122 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342258 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342393 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342540 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342683 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342820 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.342956 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.343139 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.343284 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.343429 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.343576 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.343722 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.343858 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344038 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344194 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344340 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344485 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344627 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344764 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.344907 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345044 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345210 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345355 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345558 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345718 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345855 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.345997 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346149 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346287 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346434 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346570 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346706 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346857 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.346993 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347129 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347291 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347436 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347582 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347726 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347863 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.347998 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.348164 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.348315 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.348453 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.348597 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.348769 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.348913 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.349075 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.349221 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.349390 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.349581 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.349726 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.349862 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350020 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350171 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350318 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350454 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350620 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350764 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.350924 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351068 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351217 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351373 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351511 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351655 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351792 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.351933 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.352120 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.352266 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.352426 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.352578 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.352715 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.352862 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.353006 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.353142 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.353320 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.353465 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.353657 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.354367 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.354517 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.354654 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.354869 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355008 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355150 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355293 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355437 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355572 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355707 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355852 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.355995 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356139 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356286 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356422 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356559 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356700 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356848 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.356992 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.357129 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.357272 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.357408 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.357576 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.357739 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.357876 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358011 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358146 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358288 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358431 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358581 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358725 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.358875 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.359023 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.359166 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.359315 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.359632 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.359801 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.359956 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360099 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360384 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360538 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360688 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360839 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.360997 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.361150 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.361302 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.361445 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.361659 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.361808 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.361950 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.362092 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.362243 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.362384 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.362540 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.362696 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.362891 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.363043 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.363228 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.363388 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.363532 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.363703 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.363847 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364001 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364152 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364308 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364465 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364683 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364836 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.364980 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365122 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365279 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365434 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365615 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365711 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365792 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.365870 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.366091 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.366210 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.366408 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.366503 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.366713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.366800 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367008 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367103 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367405 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367620 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367711 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.367935 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368019 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368220 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368325 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368520 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368611 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368820 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.368903 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.369126 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.369210 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.369460 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.369562 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.369807 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.369901 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.370116 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.370216 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.370428 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.370512 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.370726 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.370809 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371045 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371127 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371344 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371434 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371646 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371727 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.371943 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372025 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372245 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372340 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372564 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372645 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372845 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.372929 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.373165 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.373262 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.373455 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.373557 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.373784 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.373867 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374087 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374185 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374385 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374468 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374687 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374778 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.374984 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375069 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375294 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375385 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375598 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375681 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375896 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.375988 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.376192 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.376282 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.376495 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.376583 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.376797 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.376882 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.377093 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.377177 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.377396 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.377481 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.377727 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.377814 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378033 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378154 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378327 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378457 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378627 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378710 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.378924 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379007 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379226 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379322 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379526 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379609 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379821 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.379902 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.380126 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.380217 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.380427 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.380509 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.380725 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.380816 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381119 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381323 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381405 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381644 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381749 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.381946 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382043 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382246 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382329 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382551 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382634 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382856 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.382947 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.383153 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.383237 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.383451 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.383536 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.383747 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.383843 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384044 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384129 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384342 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384426 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384646 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384737 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.384962 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385045 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385264 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385356 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385586 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385673 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385891 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.385978 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.386192 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.386284 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.386510 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.386600 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.386813 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.386896 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.387110 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.387201 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.387409 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.387502 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.387708 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.387799 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388009 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388107 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388318 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388402 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388621 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388704 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.388924 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389010 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389229 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389319 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389556 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389657 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389859 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.389945 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.390163 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.390246 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.390473 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.390565 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.390773 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.390858 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391081 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391176 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391386 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391477 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391695 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391788 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.391993 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392076 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392291 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392458 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392606 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392698 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392913 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.392997 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.393216 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.393318 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.393550 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.393637 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.393874 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.393959 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.394183 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.394281 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.394479 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.394563 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.394782 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.394865 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395086 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395181 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395388 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395473 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395689 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395785 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.395990 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396081 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396291 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396376 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396595 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396687 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396900 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.396995 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.397203 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.397286 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.397506 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.397615 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.397833 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.397927 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.398135 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.398219 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.398435 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.398528 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.398732 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.398816 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399037 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399119 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399336 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399418 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399633 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399718 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.399936 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.400019 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.400231 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.400324 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.401044 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.401142 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.401361 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.401444 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.401695 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.401796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402003 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402109 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402315 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402405 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402625 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402718 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.402951 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403090 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403249 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403335 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403558 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403644 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403863 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.403946 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.404157 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.404240 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.404461 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.404568 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.404772 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.404864 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.405079 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.405163 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.405451 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.405554 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.405778 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.405876 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406078 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406163 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406382 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406475 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406700 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406788 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.406995 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407087 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407291 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407376 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407588 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407678 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407903 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.407994 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.408197 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.408320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.408513 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.408634 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.408920 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409011 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409224 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409315 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409552 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409640 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409849 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.409945 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.410160 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.410245 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.410483 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.410567 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.410787 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.410872 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.411092 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.411184 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.411395 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.411480 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.411716 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.411801 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412020 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412103 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412328 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412432 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412647 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412739 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.412965 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.413050 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.413270 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.413353 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.413607 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.413750 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.413907 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.414064 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.414224 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.414375 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.414539 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.414699 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.414847 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415023 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415161 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415350 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415568 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415661 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415884 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.415968 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.416264 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.416899 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.417060 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.417154 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.417382 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.417466 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.417708 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.417794 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418010 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418113 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418316 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418401 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418615 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418700 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.418916 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.419011 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.419233 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.419329 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.419531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.419617 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.419835 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420019 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420138 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420345 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420430 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420658 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420755 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.420983 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.421080 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.421308 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.421393 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.421625 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.421724 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.421934 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422057 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422246 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422331 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422553 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422647 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422862 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.422983 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.423208 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.423306 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.423472 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.423558 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.423774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.423858 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424073 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424165 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424372 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424465 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424672 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424764 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.424973 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.425057 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.425295 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.425381 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.425624 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.425711 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.425947 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.426030 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.426260 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.426344 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.426560 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.426644 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.426897 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427005 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427192 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427283 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427505 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427594 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427811 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.427903 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.428116 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.428211 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.428420 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.428512 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.428716 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.428807 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429013 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429097 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429316 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429400 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429642 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429743 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.429945 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430032 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430245 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430329 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430548 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430634 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430844 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.430928 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.431141 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.431233 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.431437 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.431523 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.431758 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.431870 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.432100 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.432195 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.432420 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.432517 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.432720 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.432812 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433018 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433102 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433320 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433421 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433640 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433733 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.433951 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434054 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434256 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434357 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434564 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434656 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434866 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.434966 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.435168 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.435260 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.435472 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.435572 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.435779 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.435880 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.436084 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.436174 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.436391 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.436488 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.436698 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.436798 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437005 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437112 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437308 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437392 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437632 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437720 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.437944 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.438028 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.438254 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.438338 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.438564 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.438651 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.438878 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.439079 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.439204 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.439403 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.439570 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.439713 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.440071 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.440275 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.440397 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.440583 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.440716 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.440891 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.441034 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.441198 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.441350 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.441504 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.441694 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.441834 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442012 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442141 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442330 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442427 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442645 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442739 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.442964 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.443056 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.443366 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.443509 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.443687 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.443795 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.443996 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.444111 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.444304 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.444426 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.444611 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.444738 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.444922 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445052 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445272 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445361 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445603 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445692 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445905 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.445991 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.446214 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.446300 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.446523 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.446607 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.446833 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.446993 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.447140 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.447221 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.447447 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.447532 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.447758 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.447851 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448064 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448157 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448367 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448459 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448670 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448766 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.448973 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.449065 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.449279 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.449409 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.449618 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.449752 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.449947 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.450063 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.450263 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.450379 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.450569 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.450696 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.450876 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.451013 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.451188 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.451325 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.451636 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.451719 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.451954 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452058 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452268 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452372 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452576 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452669 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452888 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.452979 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.453201 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.453303 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.453541 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.453630 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.453856 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.453948 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.454159 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.454250 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.454460 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.454558 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.454766 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.454870 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455071 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455171 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455370 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455462 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455686 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455893 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.455986 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.456211 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.456296 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.456546 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.456629 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.456886 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.456990 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.457194 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.457383 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.457525 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.457747 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.457847 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.458060 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.458172 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.458379 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.458464 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.458698 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.458795 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459007 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459091 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459309 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459440 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459626 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.459928 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460012 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460228 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460319 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460539 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460632 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460843 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.460935 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.461142 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.461226 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.461439 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.461699 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.461807 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462050 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462153 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462349 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462450 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462651 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462743 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.462950 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.463548 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.463796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.463898 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.464096 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.464187 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.464397 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.464497 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.464696 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.464796 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465026 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465117 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465345 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465436 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465666 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465769 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.465967 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466067 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466264 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466355 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466570 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466662 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466866 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.466956 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.467186 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.467285 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.467468 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.467568 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.467768 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.467854 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468097 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468192 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468398 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468483 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468697 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468783 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.468999 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.469091 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.469299 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.469395 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.469619 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.469720 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.469921 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470013 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470221 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470312 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470521 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470612 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470828 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.470921 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.471129 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.471214 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.471439 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.471525 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.471743 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.471837 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.472051 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.472272 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.472402 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.472604 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.472702 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.472920 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.473005 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.473246 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.473330 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.473593 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.473706 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.473903 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474006 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474202 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474287 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474502 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474818 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.474903 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.475125 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.475209 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.475432 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.475524 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.475734 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.475825 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.476039 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.476124 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.476343 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.476602 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.476688 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.476934 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477017 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477238 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477396 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477559 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477648 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477866 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.477961 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.478171 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.478270 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.478474 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.478559 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.479320 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.479411 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.479626 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.479711 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.479935 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480020 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480262 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480345 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480571 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480655 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480879 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.480963 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.481186 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.481268 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.481496 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.481650 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.481823 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.481921 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.482128 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.482220 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.482438 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.482542 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.482737 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.482821 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483046 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483140 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483356 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483442 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483660 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483744 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.483966 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.484082 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.484280 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.484610 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.484697 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.484921 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485014 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485234 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485318 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485568 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485667 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485878 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.485972 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.486190 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.486273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.486502 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.486587 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.486805 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.486901 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.487112 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.487196 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.487415 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.487499 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.487738 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.487830 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.488051 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.488135 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.488359 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.488452 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.488687 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.488989 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.489073 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.489291 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.489375 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.489612 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.489767 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.489928 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490018 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490227 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490312 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490533 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490626 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490832 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.490917 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.491187 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.491277 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.491428 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.491515 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.491727 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.491813 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492025 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492118 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492407 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492622 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492736 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.492924 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.493065 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.493220 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.493375 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.493543 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.493778 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.493866 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.494098 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.494208 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.494424 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.494507 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.494724 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.494808 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495026 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495113 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495322 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495406 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495621 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495716 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.495919 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496005 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496217 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496301 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496513 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496598 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496838 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.496939 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.497113 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.497198 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.497430 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.497542 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.497761 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.497846 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498067 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498155 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498370 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498469 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498672 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498756 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.498974 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499057 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499276 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499370 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499584 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499669 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499886 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.499968 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.500187 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.500283 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.500491 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.500588 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.500793 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.500875 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.501095 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.501186 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.501398 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.501481 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.501727 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.501814 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502034 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502120 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502359 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502444 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502679 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502763 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.502993 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.503120 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.503294 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.503379 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.503602 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.503685 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.503917 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504005 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504274 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504380 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504626 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504853 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.504938 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.505156 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.505240 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.505462 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.505641 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.505790 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.505875 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.506095 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.506179 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.506401 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.506499 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.506708 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.506798 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507008 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507092 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507312 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507397 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507623 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507707 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.507931 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508016 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508257 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508349 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508573 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508657 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508879 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.508971 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.509187 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.509271 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.509507 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.509631 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.509843 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.509940 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.510184 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.510269 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.510495 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.510586 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.510808 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.510902 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511120 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511205 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511423 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511513 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511725 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.511966 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 20:13:27.512051 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.512337 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.512653 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.512981 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.513306 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.513642 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.513972 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.514306 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.514652 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.514968 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.515312 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.515643 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.515956 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.516268 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.516572 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:13:27.516816 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 20:13:27.664370 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Registered counter for database nova_api Oct 05 20:13:27.669892 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO dbcounter [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Registered counter for database nova_api Oct 05 20:13:27.684736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.689375 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_db.sqlalchemy.engines [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.691516 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.696092 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writer thread running {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.747811 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.context [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),401763c2-8a97-48f5-b114-5efdfbd6245a(cell1) {{(pid=105351) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 20:13:27.751705 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:13:27.752174 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:13:27.752919 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.context [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),401763c2-8a97-48f5-b114-5efdfbd6245a(cell1) {{(pid=105350) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 20:13:27.753748 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:13:27.754562 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:13:27.754959 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:13:27.756941 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:13:27.757111 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_concurrency.lockutils [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:13:27.757612 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_concurrency.lockutils [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:13:27.758948 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Registered counter for database nova_cell0 Oct 05 20:13:27.759176 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_concurrency.lockutils [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:13:27.760424 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_concurrency.lockutils [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:13:27.760884 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_concurrency.lockutils [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:13:27.762904 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_concurrency.lockutils [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:13:27.763542 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Registered counter for database nova_cell1 Oct 05 20:13:27.764888 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO dbcounter [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Registered counter for database nova_cell0 Oct 05 20:13:27.768905 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO dbcounter [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Registered counter for database nova_cell1 Oct 05 20:13:27.770732 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.773063 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.776207 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_db.sqlalchemy.engines [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.778173 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.779474 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_db.sqlalchemy.engines [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.782830 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writer thread running {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.914750 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.921091 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writer thread running {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.924555 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO dbcounter [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Registered counter for database nova_cell0 Oct 05 20:13:27.931089 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO dbcounter [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Registered counter for database nova_cell0 Oct 05 20:13:27.931750 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_db.sqlalchemy.engines [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.936408 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writer thread running {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:27.937760 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG oslo_db.sqlalchemy.engines [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:13:27.942622 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writer thread running {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:13:28.272475 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:13:28.275009 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: WARNING keystonemiddleware.auth_token [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:13:28.279980 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:13:28.282344 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: WARNING keystonemiddleware.auth_token [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:13:28.618732 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:13:28.625230 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: WARNING keystonemiddleware.auth_token [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:13:28.625338 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: WARNING keystonemiddleware.auth_token [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:13:28.630511 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562e297f39c0 pid: 105351 (default app) Oct 05 20:13:28.631288 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: WARNING keystonemiddleware.auth_token [None req-52db31b7-3df4-4b02-9e49-75095886fa93 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:13:28.632560 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:13:28.633770 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Oct 05 20:13:28.634182 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Wed Oct 5 20:13:28 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:13:28.636564 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562e297f39c0 pid: 105350 (default app) Oct 05 20:14:49.517578 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:14:49.518600 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 05 20:14:49.518993 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:14:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:14:49.531657 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_api:SELECT=3 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:49.532617 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_cell0:SELECT=3 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:49.533851 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_cell1:SELECT=3 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:49.535967 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:50.387363 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-262ab877-c7e9-4ab2-aac2-a329d1247af8 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:14:50.419236 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-262ab877-c7e9-4ab2-aac2-a329d1247af8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.892708 Oct 05 20:14:50.419998 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Oct 5 20:14:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:14:53.050046 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:14:53.051070 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-04077d2f-3be7-4687-a916-9b9bc95502e2 None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 05 20:14:53.051624 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:14:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:14:53.494876 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-cff0e80d-152c-4d06-8640-77c567f360e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "swap": 0, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:14:53.542652 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-cff0e80d-152c-4d06-8640-77c567f360e2 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.485098 Oct 05 20:14:53.543229 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:14:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:14:53.557032 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=3 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:53.558082 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell1:SELECT=3 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:53.560242 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell0:SELECT=3 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:53.561071 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:14:53.770130 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-a8468e0c-bedd-4ac0-92fb-10de0934d6fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:14:53.840303 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-a8468e0c-bedd-4ac0-92fb-10de0934d6fa admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288675 Oct 05 20:14:53.841146 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Oct 5 20:14:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:14:56.441844 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-cff0e80d-152c-4d06-8640-77c567f360e2 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:14:56.443449 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-cff0e80d-152c-4d06-8640-77c567f360e2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Oct 05 20:14:56.443845 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:14:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:14:57.099209 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3bb78ceb-0b15-4459-9cdb-51f224ab0356 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:14:57.137833 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-3bb78ceb-0b15-4459-9cdb-51f224ab0356 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.687799 Oct 05 20:14:57.139194 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:14:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:14:57.151855 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-fbd3aae0-d682-4082-96d1-c5a95fad7334 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:14:57.194904 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-fbd3aae0-d682-4082-96d1-c5a95fad7334 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047422 Oct 05 20:14:57.195498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Oct 5 20:14:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:14:59.770561 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3bb78ceb-0b15-4459-9cdb-51f224ab0356 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:14:59.771580 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-3bb78ceb-0b15-4459-9cdb-51f224ab0356 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 05 20:14:59.771982 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:14:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:00.194502 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3742dc3c-5c9a-41f8-b7e7-7ef889bdd773 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "vcpus": 1, "ram": 1024, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:00.215506 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3742dc3c-5c9a-41f8-b7e7-7ef889bdd773 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437045 Oct 05 20:15:00.215998 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:14:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:00.228780 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-b9b8aa58-87ea-44de-9fb3-94f4d047617f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:00.261640 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-b9b8aa58-87ea-44de-9fb3-94f4d047617f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035084 Oct 05 20:15:00.262271 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Oct 5 20:15:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:02.871219 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3742dc3c-5c9a-41f8-b7e7-7ef889bdd773 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:02.872808 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3742dc3c-5c9a-41f8-b7e7-7ef889bdd773 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002055 Oct 05 20:15:02.878955 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:03.286209 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-ef6fc1df-056a-43c3-b222-35500379b2bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:03.306468 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-ef6fc1df-056a-43c3-b222-35500379b2bf admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426903 Oct 05 20:15:03.309558 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:03.319987 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-5c91887d-142f-4b74-8ef9-aba517e4d2ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:03.348498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-5c91887d-142f-4b74-8ef9-aba517e4d2ec admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032688 Oct 05 20:15:03.349311 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Oct 5 20:15:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:05.972736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-ef6fc1df-056a-43c3-b222-35500379b2bf admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:05.973874 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-ef6fc1df-056a-43c3-b222-35500379b2bf admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 05 20:15:05.974282 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:06.376216 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-00a0d8d6-88d6-4a19-9d7d-62f4fea13aa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "id": "d4"}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:06.397895 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-00a0d8d6-88d6-4a19-9d7d-62f4fea13aa7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.415922 Oct 05 20:15:06.398821 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:06.412442 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-7b84a180-a196-4186-a851-377650d4160b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:06.446071 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-7b84a180-a196-4186-a851-377650d4160b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038311 Oct 05 20:15:06.447093 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1336 bytes} [Wed Oct 5 20:15:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:09.122401 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-00a0d8d6-88d6-4a19-9d7d-62f4fea13aa7 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:09.123420 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-00a0d8d6-88d6-4a19-9d7d-62f4fea13aa7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Oct 05 20:15:09.123822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:09.543783 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-7d54ba3d-2c40-4f0e-8666-2eb1b4a4e53e admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:09.577159 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-7d54ba3d-2c40-4f0e-8666-2eb1b4a4e53e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445577 Oct 05 20:15:09.577877 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Oct 5 20:15:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:15:12.288728 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-00a0d8d6-88d6-4a19-9d7d-62f4fea13aa7 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:12.289770 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-00a0d8d6-88d6-4a19-9d7d-62f4fea13aa7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 05 20:15:12.290171 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:12.690809 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-e36a1c0a-f141-4556-bdcf-74abcfb52a1e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:12.711330 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-e36a1c0a-f141-4556-bdcf-74abcfb52a1e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.415041 Oct 05 20:15:12.711921 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:12.723719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-1c4bd5e8-ca73-4747-88f8-63343361b675 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:12.753167 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-1c4bd5e8-ca73-4747-88f8-63343361b675 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032962 Oct 05 20:15:12.754532 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Oct 5 20:15:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:15.352957 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-e36a1c0a-f141-4556-bdcf-74abcfb52a1e admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:15.354023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-e36a1c0a-f141-4556-bdcf-74abcfb52a1e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Oct 05 20:15:15.354437 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:15.763283 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-5a069ef1-26c7-4489-bbbb-35578d08eb62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "vcpus": 1, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:15.782857 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-5a069ef1-26c7-4489-bbbb-35578d08eb62 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.421692 Oct 05 20:15:15.783417 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:15.795263 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-c2029c92-0032-4627-b7d8-abb62ba92492 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:15.818268 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-c2029c92-0032-4627-b7d8-abb62ba92492 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026590 Oct 05 20:15:15.819559 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Oct 5 20:15:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:18.398810 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-5a069ef1-26c7-4489-bbbb-35578d08eb62 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:18.399889 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-5a069ef1-26c7-4489-bbbb-35578d08eb62 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 05 20:15:18.400453 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:18.829082 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-deb6be70-85ed-467d-b5f4-62c089f27466 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:18.851909 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-deb6be70-85ed-467d-b5f4-62c089f27466 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.445434 Oct 05 20:15:18.853005 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 20:15:18.865883 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-a0f56b0b-08a4-4363-999e-5c7793b998d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:18.893625 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-a0f56b0b-08a4-4363-999e-5c7793b998d5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031956 Oct 05 20:15:18.894486 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Oct 5 20:15:18 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:21.515839 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-deb6be70-85ed-467d-b5f4-62c089f27466 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:21.516846 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-deb6be70-85ed-467d-b5f4-62c089f27466 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 05 20:15:21.518566 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:22.019875 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-15985946-aca5-41f9-b319-d3e516efafc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:22.027575 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:15:22.044042 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-15985946-aca5-41f9-b319-d3e516efafc9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.519816 Oct 05 20:15:22.044821 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 20:15:22.057283 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-90825571-b2a2-4695-b051-55080ef4ec49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:22.086141 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-90825571-b2a2-4695-b051-55080ef4ec49 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032858 Oct 05 20:15:22.086990 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Oct 5 20:15:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:15:24.711651 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-15985946-aca5-41f9-b319-d3e516efafc9 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:24.712701 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-15985946-aca5-41f9-b319-d3e516efafc9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Oct 05 20:15:24.713350 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:25.164994 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-4c5cf744-c07e-4784-97c9-01edd5b28021 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "disk": 160, "swap": 0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:25.172545 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:15:25.186963 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-4c5cf744-c07e-4784-97c9-01edd5b28021 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.467408 Oct 05 20:15:25.187518 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1283 bytes} [Wed Oct 5 20:15:24 2022] POST /compute/v2.1/flavors => generated 408 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:25.202024 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-5d1939c7-78de-4515-9f9e-ab6ccb1910b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:25.230637 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-5d1939c7-78de-4515-9f9e-ab6ccb1910b5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034343 Oct 05 20:15:25.231273 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1333 bytes} [Wed Oct 5 20:15:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:15:42.264229 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-4c5cf744-c07e-4784-97c9-01edd5b28021 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:42.265233 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-4c5cf744-c07e-4784-97c9-01edd5b28021 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 05 20:15:42.265666 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:42.276913 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:15:42.647917 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-186748d0-1686-4e67-929b-48fe4941fadf admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:42.665668 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-186748d0-1686-4e67-929b-48fe4941fadf admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.393184 Oct 05 20:15:42.666199 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Oct 5 20:15:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:15:43.964728 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-4c5cf744-c07e-4784-97c9-01edd5b28021 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:43.965767 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-4c5cf744-c07e-4784-97c9-01edd5b28021 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Oct 05 20:15:43.966164 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:44.481911 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-9bc065c2-f991-46d7-acd5-11fe466a0374 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:44.487737 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.wsgi [None req-9bc065c2-f991-46d7-acd5-11fe466a0374 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-9bc065c2-f991-46d7-acd5-11fe466a0374 admin admin] Request method failure captured: Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Accept: application/json Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Accept-Encoding: gzip, deflate Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Connection: keep-alive Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Content-Length: 0 Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Host: 10.222.0.23 Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Openstack-Api-Version: compute 2.92 Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Openstack-System-Scope: None Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: User-Agent: python-novaclient Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Auth-Token: gAAAAABjPeXvus_UTgpUgfZ1yHYXohw7igVLfzYmCqCCHrvTq6jLHSy7FmuHXo72_q8aIiAABZx3Wt1bs3VkV_rr5_pZWpGd2lmPFSC_5acaSXvb7ovwTNxXEm1YVHFefoZ-QNVy1ukLJlpBaHAtkJLPT0NzUl-N0de7zXYao3-DVyYjMvi1T8M Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Domain-Id: None Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Domain-Name: None Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Identity-Status: Confirmed Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Is-Admin-Project: True Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Domain-Id: default Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Domain-Name: Default Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Name: admin Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Role: member,admin,reader Oct 05 20:15:44.493058 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Roles: member,admin,reader Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant: admin Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant-Name: admin Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User: admin Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Domain-Id: default Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Domain-Name: Default Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Id: c04d978bfed6492fb377cd274964302b Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Name: admin Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: method: > Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: exception: Flavor 42 could not be found. Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: action_args: {'id': '42'} Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:15:44.494713 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:44.495731 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.497152 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-9bc065c2-f991-46d7-acd5-11fe466a0374 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:15:44.498506 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-9bc065c2-f991-46d7-acd5-11fe466a0374 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.391389 Oct 05 20:15:44.498506 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Oct 5 20:15:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 20:15:44.504638 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-a259cf0a-a98e-4064-8c08-eb69033c3d25 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:44.527444 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-a259cf0a-a98e-4064-8c08-eb69033c3d25 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026643 Oct 05 20:15:44.527966 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Oct 5 20:15:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:15:44.538276 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-70a33307-0ddd-48e9-8f0e-9739b5d0e3f2 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:44.559664 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-70a33307-0ddd-48e9-8f0e-9739b5d0e3f2 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025843 Oct 05 20:15:44.560195 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Oct 5 20:15:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:15:44.570301 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-88001349-c841-4f23-9247-e5af26423b40 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:44.575483 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.wsgi [None req-88001349-c841-4f23-9247-e5af26423b40 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-88001349-c841-4f23-9247-e5af26423b40 admin admin] Request method failure captured: Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Accept: application/json Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Accept-Encoding: gzip, deflate Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Connection: keep-alive Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Content-Length: 0 Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Host: 10.222.0.23 Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Openstack-Api-Version: compute 2.92 Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Openstack-System-Scope: None Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: User-Agent: python-novaclient Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Auth-Token: gAAAAABjPeXvus_UTgpUgfZ1yHYXohw7igVLfzYmCqCCHrvTq6jLHSy7FmuHXo72_q8aIiAABZx3Wt1bs3VkV_rr5_pZWpGd2lmPFSC_5acaSXvb7ovwTNxXEm1YVHFefoZ-QNVy1ukLJlpBaHAtkJLPT0NzUl-N0de7zXYao3-DVyYjMvi1T8M Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Domain-Id: None Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Domain-Name: None Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Identity-Status: Confirmed Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Is-Admin-Project: True Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Domain-Id: default Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Domain-Name: Default Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Name: admin Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Role: member,admin,reader Oct 05 20:15:44.578736 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Roles: member,admin,reader Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant: admin Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant-Name: admin Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User: admin Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Domain-Id: default Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Domain-Name: Default Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Id: c04d978bfed6492fb377cd274964302b Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Name: admin Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: method: > Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: exception: Flavor 42 could not be found. Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: action_args: {'id': '42'} Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:15:44.580042 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:44.580796 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:44.582023 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-88001349-c841-4f23-9247-e5af26423b40 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:15:44.583805 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-88001349-c841-4f23-9247-e5af26423b40 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014014 Oct 05 20:15:44.583805 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Oct 5 20:15:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 20:15:45.797134 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-70a33307-0ddd-48e9-8f0e-9739b5d0e3f2 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:45.798175 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-70a33307-0ddd-48e9-8f0e-9739b5d0e3f2 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 05 20:15:45.798565 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:46.315651 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3dee6bbc-c6a4-4084-b9e2-9faf02e4c6fb admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:46.321228 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.wsgi [None req-3dee6bbc-c6a4-4084-b9e2-9faf02e4c6fb admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3dee6bbc-c6a4-4084-b9e2-9faf02e4c6fb admin admin] Request method failure captured: Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Accept: application/json Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Accept-Encoding: gzip, deflate Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Connection: keep-alive Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Content-Length: 0 Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Host: 10.222.0.23 Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Openstack-Api-Version: compute 2.92 Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Openstack-System-Scope: None Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: User-Agent: python-novaclient Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Auth-Token: gAAAAABjPeXxuHk-41DVjfAJJA-Gl7ZHrhR9BLSL3R9Fu-YGr9FTMpwEBYh4wIxdbxjSqEJWqRXyg-p7zRN7LXy9x0j5lvHQ1PCAz-8NLO5pfGB19ISe42Xhq2Y1vP7_r1oR7AyEDC5MDKroiLtHS2wZv-T5MltN9onaUAxASl6rLQqo3Cdcl4g Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Domain-Id: None Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Domain-Name: None Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Identity-Status: Confirmed Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Is-Admin-Project: True Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Domain-Id: default Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Domain-Name: Default Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Name: admin Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Role: member,admin,reader Oct 05 20:15:46.322774 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Roles: member,admin,reader Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant: admin Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant-Name: admin Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User: admin Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Domain-Id: default Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Domain-Name: Default Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Id: c04d978bfed6492fb377cd274964302b Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Name: admin Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: method: > Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: exception: Flavor 84 could not be found. Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: action_args: {'id': '84'} Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:15:46.324273 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:46.325239 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.326756 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3dee6bbc-c6a4-4084-b9e2-9faf02e4c6fb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:15:46.327952 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-3dee6bbc-c6a4-4084-b9e2-9faf02e4c6fb admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387278 Oct 05 20:15:46.327952 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Oct 5 20:15:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 20:15:46.333935 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-e73fdb5a-f9e5-40ea-82a5-6e1677e99797 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:46.348688 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-e73fdb5a-f9e5-40ea-82a5-6e1677e99797 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018329 Oct 05 20:15:46.349239 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Oct 5 20:15:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:15:46.358261 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-d499be97-117e-4b7b-8a85-1dd17fde14e3 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:46.377170 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-d499be97-117e-4b7b-8a85-1dd17fde14e3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.022387 Oct 05 20:15:46.377721 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Oct 5 20:15:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:15:46.387309 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-630088f6-0160-4c5b-8fd8-a0101b2809fe admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:46.392212 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.wsgi [None req-630088f6-0160-4c5b-8fd8-a0101b2809fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-630088f6-0160-4c5b-8fd8-a0101b2809fe admin admin] Request method failure captured: Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Accept: application/json Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Accept-Encoding: gzip, deflate Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Connection: keep-alive Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Content-Length: 0 Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Host: 10.222.0.23 Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Openstack-Api-Version: compute 2.92 Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Openstack-System-Scope: None Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: User-Agent: python-novaclient Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Auth-Token: gAAAAABjPeXxuHk-41DVjfAJJA-Gl7ZHrhR9BLSL3R9Fu-YGr9FTMpwEBYh4wIxdbxjSqEJWqRXyg-p7zRN7LXy9x0j5lvHQ1PCAz-8NLO5pfGB19ISe42Xhq2Y1vP7_r1oR7AyEDC5MDKroiLtHS2wZv-T5MltN9onaUAxASl6rLQqo3Cdcl4g Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Domain-Id: None Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Domain-Name: None Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Identity-Status: Confirmed Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Is-Admin-Project: True Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Domain-Id: default Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Domain-Name: Default Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Name: admin Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Role: member,admin,reader Oct 05 20:15:46.393747 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Roles: member,admin,reader Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant: admin Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant-Name: admin Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User: admin Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Domain-Id: default Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Domain-Name: Default Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Id: c04d978bfed6492fb377cd274964302b Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Name: admin Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: method: > Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: exception: Flavor 84 could not be found. Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: action_args: {'id': '84'} Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:15:46.395320 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:46.396498 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:46.397822 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-630088f6-0160-4c5b-8fd8-a0101b2809fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:15:46.398994 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-630088f6-0160-4c5b-8fd8-a0101b2809fe admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011274 Oct 05 20:15:46.398994 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Wed Oct 5 20:15:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 20:15:47.597823 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-d499be97-117e-4b7b-8a85-1dd17fde14e3 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:47.598961 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-d499be97-117e-4b7b-8a85-1dd17fde14e3 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Oct 05 20:15:47.599347 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:48.117480 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-8cd2f63f-90c1-4e1e-9ed1-2ce977fc3963 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:48.123215 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.wsgi [None req-8cd2f63f-90c1-4e1e-9ed1-2ce977fc3963 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-8cd2f63f-90c1-4e1e-9ed1-2ce977fc3963 admin admin] Request method failure captured: Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Accept: application/json Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Accept-Encoding: gzip, deflate Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Connection: keep-alive Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Content-Length: 0 Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Host: 10.222.0.23 Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Openstack-Api-Version: compute 2.92 Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Openstack-System-Scope: None Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: User-Agent: python-novaclient Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Auth-Token: gAAAAABjPeXzWZnrQfjyre-u22nnWuj-ypDZOIIuCtFqHZm72RkPLVq3xU-K09Pw9uyS1MN0H4J-y3AwE-uHJmJLbS5fGlDxXebSl0wfMLLHD7l45snJM2Mmzu1WfQT31L2lFNoRIsjkceLu0itmLby9ANvV4opD0jpJfHZau7EFxQJZYCKOLEM Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Domain-Id: None Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Domain-Name: None Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Identity-Status: Confirmed Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Is-Admin-Project: True Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Domain-Id: default Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Domain-Name: Default Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Project-Name: admin Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Role: member,admin,reader Oct 05 20:15:48.124719 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Roles: member,admin,reader Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant: admin Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-Tenant-Name: admin Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User: admin Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Domain-Id: default Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Domain-Name: Default Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Id: c04d978bfed6492fb377cd274964302b Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: X-User-Name: admin Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: method: > Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: exception: Flavor 451 could not be found. Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: action_args: {'id': '451'} Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:15:48.126241 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:48.127248 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.128596 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-8cd2f63f-90c1-4e1e-9ed1-2ce977fc3963 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:15:48.130360 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-8cd2f63f-90c1-4e1e-9ed1-2ce977fc3963 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.391790 Oct 05 20:15:48.130360 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Oct 5 20:15:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 20:15:48.136655 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-0765ae80-c83a-4c07-9d8e-eac7717f120e admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:48.152275 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-0765ae80-c83a-4c07-9d8e-eac7717f120e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019355 Oct 05 20:15:48.152813 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Oct 5 20:15:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:15:48.162208 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:48.176914 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018209 Oct 05 20:15:48.177432 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Wed Oct 5 20:15:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:15:48.186659 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3eb55aff-514d-4666-b570-d158b4c6ce3a admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:48.191904 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.wsgi [None req-3eb55aff-514d-4666-b570-d158b4c6ce3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3eb55aff-514d-4666-b570-d158b4c6ce3a admin admin] Request method failure captured: Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Accept: application/json Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Accept-Encoding: gzip, deflate Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Connection: keep-alive Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Content-Length: 0 Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Host: 10.222.0.23 Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Openstack-Api-Version: compute 2.92 Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Openstack-System-Scope: None Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: User-Agent: python-novaclient Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Auth-Token: gAAAAABjPeXzWZnrQfjyre-u22nnWuj-ypDZOIIuCtFqHZm72RkPLVq3xU-K09Pw9uyS1MN0H4J-y3AwE-uHJmJLbS5fGlDxXebSl0wfMLLHD7l45snJM2Mmzu1WfQT31L2lFNoRIsjkceLu0itmLby9ANvV4opD0jpJfHZau7EFxQJZYCKOLEM Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Domain-Id: None Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Domain-Name: None Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Identity-Status: Confirmed Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Is-Admin-Project: True Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Domain-Id: default Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Domain-Name: Default Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Project-Name: admin Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Role: member,admin,reader Oct 05 20:15:48.193942 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Roles: member,admin,reader Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/e6d76b1c203e49b8ae5f7f394a20a597"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant: admin Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant-Id: e6d76b1c203e49b8ae5f7f394a20a597 Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-Tenant-Name: admin Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User: admin Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Domain-Id: default Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Domain-Name: Default Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Id: c04d978bfed6492fb377cd274964302b Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: X-User-Name: admin Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: method: > Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: exception: Flavor 451 could not be found. Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: action_args: {'id': '451'} Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:15:48.195463 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:48.196321 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: ERROR nova.api.openstack.wsgi Oct 05 20:15:48.197531 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-3eb55aff-514d-4666-b570-d158b4c6ce3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:15:48.198765 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-3eb55aff-514d-4666-b570-d158b4c6ce3a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012396 Oct 05 20:15:48.198765 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Oct 5 20:15:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 20:15:49.398866 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:49.399882 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Oct 05 20:15:49.400281 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:49.918417 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-d5c9433c-4a87-40c8-b272-710ba72fb397 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:49.937112 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-d5c9433c-4a87-40c8-b272-710ba72fb397 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.399439 Oct 05 20:15:49.937700 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Oct 5 20:15:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 20:15:51.150702 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:51.151702 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Oct 05 20:15:51.152095 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:51.668134 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-c22e0b35-19c1-44d9-a09b-2b31127dd0ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:51.686150 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-c22e0b35-19c1-44d9-a09b-2b31127dd0ac admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.397571 Oct 05 20:15:51.686689 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Oct 5 20:15:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:52.910577 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:52.911721 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Oct 05 20:15:52.912115 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:53.423461 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-a5604994-8e64-414a-bcb7-70f05c6aa248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:53.443332 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-a5604994-8e64-414a-bcb7-70f05c6aa248 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393609 Oct 05 20:15:53.443862 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Oct 5 20:15:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:54.661700 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:54.662741 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Oct 05 20:15:54.663137 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:55.181991 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-82e94262-af26-40dc-9dd3-5dc3e6c31fd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:15:55.200624 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-82e94262-af26-40dc-9dd3-5dc3e6c31fd3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.402462 Oct 05 20:15:55.201160 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Wed Oct 5 20:15:54 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:15:56.409418 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:56.410467 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 05 20:15:56.411382 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:15:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:15:56.924500 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-df7c48cc-f1f4-438b-993b-357ccbceba0b admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:15:56.944573 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-df7c48cc-f1f4-438b-993b-357ccbceba0b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.397528 Oct 05 20:15:56.945108 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Wed Oct 5 20:15:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:16:53.183440 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:16:53.184459 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-3c03cb4a-6fc5-4dc9-89bb-6689f7195f5c admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 05 20:16:53.184861 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 931 bytes} [Wed Oct 5 20:16:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:16:53.196266 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:16:53.579313 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-016f88a6-7b78-4a61-b207-6c6273a762a7 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:16:53.599291 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-016f88a6-7b78-4a61-b207-6c6273a762a7 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408027 Oct 05 20:16:53.599828 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1292 bytes} [Wed Oct 5 20:16:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:16:53.620932 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_api:SELECT=14 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:16:53.624768 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-ed2f8d18-e8f6-4a5d-9e3a-d2c6d2f9ca2c admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:16:53.632706 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-ed2f8d18-e8f6-4a5d-9e3a-d2c6d2f9ca2c admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013182 Oct 05 20:16:53.633229 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1283 bytes} [Wed Oct 5 20:16:53 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:16:53.644611 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-9b16c1e6-8e28-4617-a73e-fca3b40a774d admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:16:53.651797 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-9b16c1e6-8e28-4617-a73e-fca3b40a774d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010711 Oct 05 20:16:53.652303 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1286 bytes} [Wed Oct 5 20:16:53 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:16:53.663507 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:16:53.670667 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010772 Oct 05 20:16:53.671528 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1286 bytes} [Wed Oct 5 20:16:53 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:16:53.682955 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-7fba8486-e360-4a47-a08f-077dfcef4f1b admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:16:53.689973 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-7fba8486-e360-4a47-a08f-077dfcef4f1b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010445 Oct 05 20:16:53.690481 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1283 bytes} [Wed Oct 5 20:16:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:19:51.919764 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:19:51.920817 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Oct 05 20:19:51.921242 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 34/69] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:19:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:19:52.062422 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=6 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:19:52.220604 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:19:52.225528 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:19:52.226025 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:19:52.226448 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:19:52.227186 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:19:52.227630 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:19:52.228041 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:19:52.259033 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-c76827c2-48d3-4849-a6cb-4b398a78c607 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.197846 Oct 05 20:19:52.259573 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 36/70] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Oct 5 20:19:52 2022] GET /compute/v2.1/os-services => generated 794 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:19:53.339654 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:19:53.340653 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Oct 05 20:19:53.341041 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 35/71] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:19:53.530474 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:19:53.533918 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:19:53.534422 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:19:53.534848 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:19:53.535560 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:19:53.536005 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:19:53.536418 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:19:53.555910 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-a7f6d8cc-7db2-47f1-aa91-09cf80c364e1 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.075646 Oct 05 20:19:53.556390 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 37/72] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Oct 5 20:19:53 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:20:05.044281 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:20:05.045276 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 05 20:20:05.045693 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 36/73] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:20:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:20:05.187073 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell0:SELECT=4 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:20:05.187725 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_cell1:SELECT=4 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:20:05.188339 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG dbcounter [-] [105351] Writing DB stats nova_api:SELECT=8 {{(pid=105351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:20:05.236519 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:20:05.239966 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:20:05.240458 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:20:05.240875 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:20:05.241624 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:20:05.242077 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:20:05.242496 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:20:05.266935 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-9ef2b3e5-b3fa-4b5f-a16c-63dd93e13df9 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.084352 Oct 05 20:20:05.267485 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 38/74] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Oct 5 20:20:05 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:20:06.328721 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG nova.api.openstack.wsgi [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] Calling method '>' {{(pid=105350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:20:06.329693 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: INFO nova.api.openstack.requestlog [None req-fcfd0dbd-d82a-41db-be08-2dab857e8df9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Oct 05 20:20:06.330090 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: [pid: 105350|app: 0|req: 37/75] 10.222.0.23 () {56 vars in 1074 bytes} [Wed Oct 5 20:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:20:06.519747 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG nova.api.openstack.wsgi [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Calling method '>' {{(pid=105351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:20:06.523119 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:20:06.523620 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:20:06.524043 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:20:06.524753 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:20:06.525193 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:20:06.525629 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: DEBUG oslo_concurrency.lockutils [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:20:06.547114 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: INFO nova.api.openstack.requestlog [None req-947c7e66-120b-4a58-b9d0-67c9fe40af76 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078238 Oct 05 20:20:06.547588 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: [pid: 105351|app: 0|req: 39/76] 10.222.0.23 () {60 vars in 1193 bytes} [Wed Oct 5 20:20:06 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:21:00.892534 dv-cinder-801522-12-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 05 20:21:00.893047 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: Wed Oct 5 20:21:00 2022 - graceful shutdown triggered... Oct 05 20:21:00.893452 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: Gracefully killing worker 1 (pid: 105350)... Oct 05 20:21:00.893847 dv-cinder-801522-12-iscsi devstack@n-api.service[105351]: Gracefully killing worker 2 (pid: 105351)... Oct 05 20:21:01.019517 dv-cinder-801522-12-iscsi devstack@n-api.service[105350]: DEBUG dbcounter [-] [105350] Writing DB stats nova_api:SELECT=4 {{(pid=105350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:01.893639 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: worker 1 buried after 1 seconds Oct 05 20:21:01.894132 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: worker 2 buried after 1 seconds Oct 05 20:21:01.894132 dv-cinder-801522-12-iscsi devstack@n-api.service[105349]: goodbye to uWSGI. Oct 05 20:21:01.895220 dv-cinder-801522-12-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 05 20:21:01.895782 dv-cinder-801522-12-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 05 20:21:01.898612 dv-cinder-801522-12-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 20:21:01.909435 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 20:21:01 2022] *** Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: nodename: dv-cinder-801522-12-iscsi Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: machine: x86_64 Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: clock source: unix Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: pcre jit disabled Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: detected number of CPU cores: 4 Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: current working directory: / Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: detected binary path: /usr/bin/uwsgi-core Oct 05 20:21:01.911410 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: your processes number limit is 47680 Oct 05 20:21:01.912249 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: your memory page size is 4096 bytes Oct 05 20:21:01.912249 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: detected max file descriptor number: 2048 Oct 05 20:21:01.912249 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: lock engine: pthread robust mutexes Oct 05 20:21:01.912249 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: thunder lock: enabled Oct 05 20:21:01.912249 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 20:21:01.912249 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 20:21:01.951306 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: Python main interpreter initialized at 0x56147a0289c0 Oct 05 20:21:01.951306 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: python threads support enabled Oct 05 20:21:01.951306 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: your server socket listen backlog is limited to 100 connections Oct 05 20:21:01.951306 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: your mercy for graceful operations on workers is 90 seconds Oct 05 20:21:01.951706 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 20:21:01.951706 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: *** Operational MODE: preforking *** Oct 05 20:21:01.951990 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: *** uWSGI is running in multiple interpreter mode *** Oct 05 20:21:01.951990 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: spawned uWSGI master process (pid: 120337) Oct 05 20:21:01.955619 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: spawned uWSGI worker 1 (pid: 120350, cores: 1) Oct 05 20:21:01.955619 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: spawned uWSGI worker 2 (pid: 120351, cores: 1) Oct 05 20:21:01.955619 dv-cinder-801522-12-iscsi devstack@n-api.service[120337]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 20:21:01.952190 dv-cinder-801522-12-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 05 20:21:02.621839 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 20:21:02.630054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 20:21:03.782901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:21:03.782901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: from cryptography.utils import int_from_bytes Oct 05 20:21:03.783681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:21:03.783681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: from cryptography.utils import int_from_bytes Oct 05 20:21:03.797365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:21:03.797365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: from cryptography.utils import int_from_bytes Oct 05 20:21:03.797968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 20:21:03.797968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: from cryptography.utils import int_from_bytes Oct 05 20:21:06.204216 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 20:21:06.204811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 20:21:06.205177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 20:21:06.205362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 20:21:06.205596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 20:21:06.205994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.206324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.206649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.206972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.207305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.207622 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.207951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.208275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.208610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.208875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.209196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.209717 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-12-iscsi {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.210052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.210367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.210684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.211011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.211322 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.211648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.211959 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.212469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.213937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.213937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.213937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.213937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.214266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.214515 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.214822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.215126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.215458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.215767 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.216174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-12-iscsi {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.216508 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.216828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.217136 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.217582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.217894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.218208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.218535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.219463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.219783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.220111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.220441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.220755 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.221080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.221404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.221729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.222045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.222363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.222674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.222982 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.223237 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.223546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.223872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.224195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.224519 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.224777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.225031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.225352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.225700 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.226012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.226324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.226631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.226940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.227249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.227560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.227868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.228187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.228456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 20:21:06.228886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.228971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 20:21:06.229069 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.229148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.229339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 20:21:06.229445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.229707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 20:21:06.229811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.229885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 20:21:06.230138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.230304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.230405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.230617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.230727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.230946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.231045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.231274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.231445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.231602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.231752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.231918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.232068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.232240 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.232389 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.232546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.232716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.232861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233012 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233154 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.233936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801522-12-iscsi {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.234089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.234256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.235051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.235213 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.235414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.235565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.235707 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.235861 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236022 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236164 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236325 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236774 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.236916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.237057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.237199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.237358 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.237499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.237703 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.237876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.238931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.239080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.239222 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.239448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.239600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.240057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.240236 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.240434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.240592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.240753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.241006 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.241157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.241300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801522-12-iscsi {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.241562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.241735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.241887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242228 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242675 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.242829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.243106 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.243256 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.243397 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.243538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.243686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.243843 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.244008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.244337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.244503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.244654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.244797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.249093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.249275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.249429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.249611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.249776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.250815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.251012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.251268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.251425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.251689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.251840 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.251984 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.252142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.252286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.252436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.252585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.252735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.252886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.253028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.253178 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.253328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.253470 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.253647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.253804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.254516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.254675 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.254832 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.254975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.255119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.255270 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.255414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.255570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.255761 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.255921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.256954 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.257104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.257104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.257400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.257576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.257725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.257879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.258028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.258179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.258327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.258479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.258628 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.258771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.258924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.259128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.259285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.259435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.259589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.259776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.259937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.260282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.260442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.260596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.261006 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.261157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.261421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.261676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.261929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.262080 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.262231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.262868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.263041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.263185 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.263336 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.263478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.263620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.263770 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.263925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.264075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.264224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.264375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.264523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.264691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.264844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.264987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.265128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.265270 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.265426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.265599 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.266405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.266550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.266699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.266842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.266984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.267135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.267295 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.267437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.267586 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.267971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.268128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.268281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.268430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.268571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.268571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.268849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.269205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.269365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.269547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.269720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.269882 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.270025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.270337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.270496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.270649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.270802 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.271200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.271361 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.271662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.271813 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.271982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.272232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.272402 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.272553 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.272709 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.272853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.273001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.273143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.273285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.273426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.273605 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.273755 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.273898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.274039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.274199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.274344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.274485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.274625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.274779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.274929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.275079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.275231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.275380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.275529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.275752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.275897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.276054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.276220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.276364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.276505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.276654 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.276805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.276957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.277105 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.277261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.277404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.277576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.277740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.277884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.278025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.278178 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.278326 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.278477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.278633 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.278776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.278925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.279073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.279287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.279446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.279598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.279742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.279884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.280033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.280193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.280370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.280606 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.280765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.280914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.281075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.281430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.281661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.281901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.282057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.282226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.282462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.282619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.282783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.282939 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.283083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.283224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.283373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.283515 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.283672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 20:21:06.283823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.283965 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.284115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.284266 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.284418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.284418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.284705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.284857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285007 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285156 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285156 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.285976 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.286125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.286280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.286430 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.286588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.286730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.286872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287012 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287167 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287756 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.287917 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288518 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288667 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.288968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.289117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.289259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.289460 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.289644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.289804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.289949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.290091 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.290232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.290394 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.290549 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.290722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.290865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.291007 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.291156 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.291550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.291717 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.291717 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.292135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.292294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.292469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.292698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.292869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.293942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.294084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.294234 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.294381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.294531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.294686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.294852 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.295852 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.296001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.296142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.296293 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.296436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.296583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.296735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.297008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.297172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.297332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.297475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.297795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.297949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298102 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298397 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.298993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.299191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.299386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.299544 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.299701 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.299843 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.299984 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.300138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.300286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.300435 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.300583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.300729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.300889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.301040 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.301190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.301332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.301618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.301773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.301923 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.302075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.302321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.302480 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.302625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.302875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.303033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.303269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.303422 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.303565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.303714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.303857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304443 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.304880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305030 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305188 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305835 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.305985 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.306133 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.306282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.306423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.306563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.306718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.306861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307002 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.307884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.308025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.308662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.308828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.308974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.309117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.309259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.309418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.309685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.309844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.309996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.310147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.310289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.310438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.310592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.310749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.310900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.311732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.311896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.312040 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.312209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.312377 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.313183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.313332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.313475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.313641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.313806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.313949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314240 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.314988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.315131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.315273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.315421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.315577 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.315720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.315869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.316011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.316153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.316304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.316454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.316845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.317992 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318581 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318760 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.318922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319002 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319267 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319349 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319704 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.319954 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320113 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.320993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321320 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321489 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.321960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322040 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.322961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323271 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.323927 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324432 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.324947 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325366 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325745 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.325965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326127 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326206 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326502 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.326928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327176 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.327952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.328034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.328708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.328814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.328898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.328988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329150 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329487 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.329938 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330381 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.330976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331318 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331646 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331831 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.331918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332256 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332594 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332675 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.332942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333539 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333631 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333851 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.333944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.334161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.334261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.334481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.334606 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.334795 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.334896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.335101 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.335210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.335418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.335522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.335730 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.335825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336037 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336167 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336661 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.336966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.337063 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.337273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.337369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.337608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.337727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.337934 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.338031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.338252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.338523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.338635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.338859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.338968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.339164 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.339273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.339470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.339576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.339777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.339890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.340086 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.340254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.340423 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.340604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.340754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.340904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341822 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.341983 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.342252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.342422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.342566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.342709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.342859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.343009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.343162 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.343312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.343475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.343842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.343995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.344151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.344305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.344448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.344610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.344767 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.344910 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.345053 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.345244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.345396 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.345587 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.345741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.345885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346191 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346629 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346770 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.346920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347362 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347654 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.347951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.348100 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.348243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.348385 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.348536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.348693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.348836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.349026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.349183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.349328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.349478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.349665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.349862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350763 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.350905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351781 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.351924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.352074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.352317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.352548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.352705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.352856 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.353000 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.353148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.353304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.353453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.353629 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.353966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354555 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354851 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.354994 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.355179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.355902 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356060 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.356950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.357100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.357255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.357398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.357591 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.357743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.357893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.358941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.359094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.359252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.359424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.359578 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.359728 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.361609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.362953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363041 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363706 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363801 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.363979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364061 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364457 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364539 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.364983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365240 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365329 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.365967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366051 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.366953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.367762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368406 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.368947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.369056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.369270 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.369361 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.369611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.369719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370492 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.370988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.371176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.371306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.371487 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.371633 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.371797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.371963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.372126 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.372274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.372447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.372584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.372767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.372899 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.373095 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.373193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.373426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.373531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.373784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.373877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.374098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.374188 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.374414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.374512 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.374731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.374820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.375576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.375696 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.375886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.375996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.376193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.376284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.376509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.376613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.376814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.376912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.377139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.377411 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.377502 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.377759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.377850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.378079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.378172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.378395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.378493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.378713 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.378804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379022 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.379949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.380059 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.380268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.380470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.380592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.380711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.380909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.381021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.381229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.381330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.381562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.381670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.381887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382335 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382885 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.382983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.383200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.383304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.383523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.383621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.383855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.383945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.384166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.384267 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.384475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.384564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.384786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.384905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.385094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.385229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.385401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.385574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.385739 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.385979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386348 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.386964 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.387176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.387274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.387491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.387582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.387805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.387897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.388119 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.388209 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.388453 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.388551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.388768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.388866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.389080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.389168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.389425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.389533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.389776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.389868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.390108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.390212 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.390424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.390584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.391293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.391431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.391617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.391752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.391936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.392086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.392254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.392419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.392570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.392752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.392889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.393068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.393206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.393391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.393561 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.393733 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.393857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.394067 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.394179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.394400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.394498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.394722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.394812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.395045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.395323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.395420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.395662 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.395759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.395985 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.396093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.396303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.396393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.396620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.396717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.396942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.397033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.397260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.397371 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.397608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.397707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.397928 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398561 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398673 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.398989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.399225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.399319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.399557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.399660 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.399894 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.399982 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.400218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.400305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.400531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.400647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.400849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.400939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.401168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.401258 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.401485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.401611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.401817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.401915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.402129 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.402219 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.402461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.402551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.402769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.402857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.403086 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.403176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.403402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.403493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.403717 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.403807 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404344 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404747 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.404971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.405074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.405281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.405371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.405624 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.405757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.405953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.406064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.406318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.406412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.406645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.406735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.406966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.407066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.407283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.407381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.407606 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.407695 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.407927 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.408131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.408268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.408451 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.408602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.408790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.408930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.409120 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.409247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.409450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.409580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.409801 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.409923 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.410124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.410221 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.410458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.410562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.410773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.410954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.411081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.411172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.411401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.411492 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.411714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.411804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.412947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.413036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.413272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.413362 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.413604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.413697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.413939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.414142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.414256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.414496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.414600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.414818 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.414915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.415147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.415241 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.415476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.415567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.415796 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.415894 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.416107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.416197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.416431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.416520 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.416740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.416829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.417050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.417135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.417369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.417449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.417712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.417804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418126 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.418964 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419063 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419674 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.419993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.420220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.420323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.420529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.420771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.420870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.421092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.421197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.421413 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.421503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.421757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.421877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.422093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.422184 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.422404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.422493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.422713 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.422812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423127 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.423973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.424064 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.424311 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.424400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.424644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.424743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.424978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.425068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.425283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.425372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.425635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.425730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.425945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.426988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.427217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.427316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.427535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.427627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.427850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.427948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.428171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.428272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.428492 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.428581 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.428811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.429029 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.429119 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.429371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.429462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.429743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.429836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.430071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.430159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.430388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.430488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.430707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.430820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431020 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431129 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431661 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.431976 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.432081 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.432292 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.432390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.432607 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.432698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.432922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.433022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.433237 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.433448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.433571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.433796 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.433893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.434137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.434229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.434473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.434572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.434785 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.434883 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.435099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.435197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.435414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.435503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.435729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.435829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436780 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.436992 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.437090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.437304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.437403 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.438195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.438289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.438514 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.438614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.438825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.438917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.439152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.439251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.439464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.439564 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.439780 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.440007 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.440111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.440372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.440458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.440696 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.440798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.441066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.441168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.441352 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.441442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.441955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.442051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.442271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.442372 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.442605 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.442703 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.442919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443553 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.443969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.444180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.444271 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.444491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.444766 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.444852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.444935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.445111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.445203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.445421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.445532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.445770 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.445875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.446081 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.446172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.446402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.446491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.446711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.446814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447423 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.447953 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448349 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448569 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448671 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.448963 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.449182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.449282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.449490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.449627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.449822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.449902 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.450135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.450222 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.450442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.450534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.450750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.450869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451490 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.451981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.452131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.452293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.452441 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.452599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.452763 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.452905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.453152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.453819 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.454033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.454143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.454404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.454516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.454677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.454769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.455029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.455120 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.455353 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.455442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.455724 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.455900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.456037 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.456243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.456364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.456571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.456670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.456912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.457011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.457252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.457349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.457590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.457685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.457906 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.458953 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.459180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.459277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.459493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.459581 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.459806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.459898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.460118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.460223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.460436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.460525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.460754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.460844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.461067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.461166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.461386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.461561 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.461735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.461842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.462055 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.462184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.462373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.462474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.462689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.462779 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463005 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463098 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.463953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.464999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.465213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.465310 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.465541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.465654 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.465862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.465951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.466180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.466270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.466506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.466605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.466833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.466923 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.467147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.467246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.467458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.467558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.467794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.467883 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.468141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.468240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.468458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.468556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.468828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.468931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.469152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.469241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.469469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.469572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.469825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.469924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.470132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.470220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.470378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120350) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 20:21:06.470476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.470769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.471107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.471461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.471800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.472133 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.472446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.472758 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.473069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.473386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.473735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.474052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.474361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.474671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.474985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.475294 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.475604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.475912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.476220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.476533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.476839 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.477148 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.477456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.477808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.478378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.478693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.479010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.479316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.479625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.479932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.480247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.480556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.480895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.481235 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.481580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.481916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.482234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.482563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.482878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.483207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.483535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.483855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.484171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.484538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.484858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.485176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.485496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.485842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.486159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.486474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.486812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.487150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.487464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.487797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.488124 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.488447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.488769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.489092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.489428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.489772 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.490092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.490415 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.490734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.491069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.491393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.491715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.492037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.492359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.492680 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.493013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.493346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.493698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.494034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.494368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.494720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.495039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.495390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.495722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.496043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.496360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.496672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 20:21:06.496920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120351) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 20:21:06.531533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO dbcounter [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Registered counter for database nova_api Oct 05 20:21:06.551639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_db.sqlalchemy.engines [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.558274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writer thread running {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.558503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO dbcounter [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Registered counter for database nova_api Oct 05 20:21:06.580015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_db.sqlalchemy.engines [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.586637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writer thread running {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.615426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.context [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),401763c2-8a97-48f5-b114-5efdfbd6245a(cell1) {{(pid=120350) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 20:21:06.619487 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:21:06.619967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:21:06.621559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:21:06.622306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:21:06.622757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:21:06.624752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:21:06.627407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO dbcounter [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Registered counter for database nova_cell0 Oct 05 20:21:06.631433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO dbcounter [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Registered counter for database nova_cell1 Oct 05 20:21:06.638894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_db.sqlalchemy.engines [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.640619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_db.sqlalchemy.engines [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.643247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.context [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),401763c2-8a97-48f5-b114-5efdfbd6245a(cell1) {{(pid=120351) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 20:21:06.646943 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writer thread running {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.647366 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:21:06.647851 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:21:06.648238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writer thread running {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.649445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:21:06.650204 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:21:06.650677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:21:06.652690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:21:06.654750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO dbcounter [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Registered counter for database nova_cell0 Oct 05 20:21:06.658861 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO dbcounter [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Registered counter for database nova_cell1 Oct 05 20:21:06.666162 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_db.sqlalchemy.engines [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.668377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_db.sqlalchemy.engines [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.674452 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writer thread running {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.679715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writer thread running {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.797577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO dbcounter [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Registered counter for database nova_cell0 Oct 05 20:21:06.804239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_db.sqlalchemy.engines [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120350) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.808893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writer thread running {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:06.825437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO dbcounter [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Registered counter for database nova_cell0 Oct 05 20:21:06.832249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_db.sqlalchemy.engines [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120351) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 20:21:06.836933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writer thread running {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 20:21:07.128622 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: WARNING keystonemiddleware.auth_token [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:21:07.135970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: WARNING keystonemiddleware.auth_token [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:21:07.159896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: WARNING keystonemiddleware.auth_token [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:21:07.167262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: WARNING keystonemiddleware.auth_token [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:21:07.484223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: WARNING keystonemiddleware.auth_token [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:21:07.490216 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: WARNING keystonemiddleware.auth_token [None req-0f2af12d-3d1c-471e-8cce-fffdccbd931a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:21:07.495571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56147a0289c0 pid: 120350 (default app) Oct 05 20:21:07.517801 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: WARNING keystonemiddleware.auth_token [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 20:21:07.523834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: WARNING keystonemiddleware.auth_token [None req-02170d7d-d223-40a6-8c51-740a6faafc8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 20:21:07.529150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56147a0289c0 pid: 120351 (default app) Oct 05 20:21:41.118237 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:41.119872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:41.120844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:41.121797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:41.908356 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-95cafef7-b31a-43c5-b27f-cd93f6f60b90 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Action: 'create', calling method: .version_select at 0x7f3e03597550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1323696990"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:21:43.276576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-95cafef7-b31a-43c5-b27f-cd93f6f60b90 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.179834 Oct 05 20:21:43.287004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Wed Oct 5 20:21:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2193 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 20:21:43.515933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-06dde1cf-c47d-432c-ba16-dc5ae6c93f4b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e036240d0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:43.548161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:43.549033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:43.549848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:43.550582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:21:45.214498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-06dde1cf-c47d-432c-ba16-dc5ae6c93f4b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 200 len: 346 microversion: 2.1 time: 1.925746 Oct 05 20:21:45.215691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 1/2] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:21:43 2022] GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 346 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:45.231312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-991463e1-918c-42a8-b7d1-7d4db0b5fd8a tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Action: 'create', calling method: .version_select at 0x7f3e0346d3a0>, body: {"snapshot": {"volume_id": "1373ad7d-024b-4933-8c6e-92fd221b4f95", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1311866899"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:21:45.807453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-991463e1-918c-42a8-b7d1-7d4db0b5fd8a tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.581133 Oct 05 20:21:45.808697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 2/3] 10.222.0.23 () {60 vars in 1162 bytes} [Wed Oct 5 20:21:45 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:45.820761 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3f5da2c2-20c5-4a74-a002-ae7780fafac3 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0344e3a0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:46.300327 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3f5da2c2-20c5-4a74-a002-ae7780fafac3 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 200 len: 287 microversion: 2.1 time: 0.483595 Oct 05 20:21:46.301175 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 2/4] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:45 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 287 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:21:46.315119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3624b68e-b74c-49cb-a7f7-e7539338a4dc tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03402670>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:46.460691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3624b68e-b74c-49cb-a7f7-e7539338a4dc tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.151728 Oct 05 20:21:46.474899 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-94613836-dfca-4fcc-a858-99abd3f66e53 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0344e430>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:46.480600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 3/5] 10.222.0.23 () {58 vars in 1140 bytes} [Wed Oct 5 20:21:46 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:46.968310 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-94613836-dfca-4fcc-a858-99abd3f66e53 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 200 len: 287 microversion: 2.1 time: 0.498255 Oct 05 20:21:46.974878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 3/6] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:46 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 287 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:47.986487 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-faac3883-e6af-4de2-bc77-cfe107386f41 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03402c10>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:48.023217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-faac3883-e6af-4de2-bc77-cfe107386f41 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 200 len: 287 microversion: 2.1 time: 0.044972 Oct 05 20:21:48.028710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 4/7] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:47 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:49.038624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1184f4ef-a810-42e7-a5a0-3f8b7aa6345d tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0344eb80>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:49.086083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1184f4ef-a810-42e7-a5a0-3f8b7aa6345d tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 200 len: 287 microversion: 2.1 time: 0.052766 Oct 05 20:21:49.091492 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 4/8] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:49 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:50.101380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7f69bdf3-49f9-4d36-937a-4aed9f45d40f tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e034024c0>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:50.169447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7f69bdf3-49f9-4d36-937a-4aed9f45d40f tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 200 len: 288 microversion: 2.1 time: 0.073216 Oct 05 20:21:50.177139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 5/9] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:50 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:50.191538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-946cd669-75ee-4c64-9cf3-7082f7003b2e tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03466280>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:50.423341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-946cd669-75ee-4c64-9cf3-7082f7003b2e tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 202 len: 0 microversion: 2.1 time: 0.244777 Oct 05 20:21:50.424207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 5/10] 10.222.0.23 () {58 vars in 1254 bytes} [Wed Oct 5 20:21:50 2022] DELETE /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:21:50.434373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5a8f5ae3-750b-4bc1-9189-7bedaccd471a tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0346df70>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:50.510290 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5a8f5ae3-750b-4bc1-9189-7bedaccd471a tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 200 len: 287 microversion: 2.1 time: 0.079402 Oct 05 20:21:50.510852 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 6/11] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:50 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:51.530264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-177bfe79-fa82-4f6e-a9ae-05408fe71519 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0344ed30>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:51.588998 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-177bfe79-fa82-4f6e-a9ae-05408fe71519 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] HTTP exception thrown: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-177bfe79-fa82-4f6e-a9ae-05408fe71519 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Request method failure captured: Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e HTTP/1.1 Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedUeUdZrPGa9fgqhjYpLy4wXBK0-1eEQe7S8JUuQkIpewQ9Uwe8dG8rMU2bl6nEqVkFOhpi2Qke8xIUKU4WD_J9A7VvLZO9WOjd5fmAODgWFq_FbsWkegZdte0mKw7aA9XYaQwRjlfDergmqn7dnPDlRvzO8z5S-AsrF6iKpS1bf6g Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:21:51.596616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 04c46460cf0c478fbf21499f6cceaf65 Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'b863bf5f-2a0a-4183-bb45-6d8e772b845e'} Oct 05 20:21:51.597885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. (HTTP 404) (Request-ID: req-643b4240-70ed-4d4c-bec1-b7e5410baa0b) Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.598708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:21:51.599702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 05 20:21:51.600710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. Oct 05 20:21:51.603530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:51.607777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-177bfe79-fa82-4f6e-a9ae-05408fe71519 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Returning 404 to user: Snapshot b863bf5f-2a0a-4183-bb45-6d8e772b845e could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:21:51.609184 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-177bfe79-fa82-4f6e-a9ae-05408fe71519 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e" status: 404 len: 111 microversion: 2.1 time: 0.088277 Oct 05 20:21:51.611944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 6/12] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:21:51 2022] GET /compute/v2.1/os-snapshots/b863bf5f-2a0a-4183-bb45-6d8e772b845e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:21:51.620533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bb98cf30-84cf-4ecc-9503-8cfd547f23a6 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03402160>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:51.844654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bb98cf30-84cf-4ecc-9503-8cfd547f23a6 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 202 len: 0 microversion: 2.1 time: 0.229551 Oct 05 20:21:51.845214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 7/13] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:21:51 2022] DELETE /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:21:51.855598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2c05cebe-6feb-4722-ba21-bd8437ca8b59 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03dc5b80>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:51.984437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2c05cebe-6feb-4722-ba21-bd8437ca8b59 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 200 len: 345 microversion: 2.1 time: 0.133177 Oct 05 20:21:51.986100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 7/14] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:21:51 2022] GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:53.000738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0e7d8713-1b99-47cc-9b74-28452ed6df93 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03402b80>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:53.148113 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0e7d8713-1b99-47cc-9b74-28452ed6df93 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 200 len: 345 microversion: 2.1 time: 0.150217 Oct 05 20:21:53.155739 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 8/15] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:21:52 2022] GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 345 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:54.164173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-45c68df0-f966-4b6e-a04e-3895a2a393c0 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0344eca0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:54.308075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-45c68df0-f966-4b6e-a04e-3895a2a393c0 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 200 len: 345 microversion: 2.1 time: 0.148754 Oct 05 20:21:54.308996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 8/16] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:21:54 2022] GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:21:55.165632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-362535197", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:21:55.324935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a75f6232-21d5-4b7c-8af2-611e31aa6262 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0345c4c0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:55.421033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-a75f6232-21d5-4b7c-8af2-611e31aa6262 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] HTTP exception thrown: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a75f6232-21d5-4b7c-8af2-611e31aa6262 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Request method failure captured: Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 HTTP/1.1 Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedUeUdZrPGa9fgqhjYpLy4wXBK0-1eEQe7S8JUuQkIpewQ9Uwe8dG8rMU2bl6nEqVkFOhpi2Qke8xIUKU4WD_J9A7VvLZO9WOjd5fmAODgWFq_FbsWkegZdte0mKw7aA9XYaQwRjlfDergmqn7dnPDlRvzO8z5S-AsrF6iKpS1bf6g Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:21:55.423359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 04c46460cf0c478fbf21499f6cceaf65 Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '1373ad7d-024b-4933-8c6e-92fd221b4f95'} Oct 05 20:21:55.424336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. (HTTP 404) (Request-ID: req-a0e6da96-08c6-4767-8a1b-506d9d810325) Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.424937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:21:55.426295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 20:21:55.427196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a75f6232-21d5-4b7c-8af2-611e31aa6262 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Returning 404 to user: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a75f6232-21d5-4b7c-8af2-611e31aa6262 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 404 len: 109 microversion: 2.1 time: 0.105202 Oct 05 20:21:55.428969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 9/17] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:21:55 2022] GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:21:55.441068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-630131af-77bd-4372-86a0-a04884aaba26 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e03dc5820>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:55.491654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] validate_networks() for [('cc456dbc-ea96-4537-b89e-3b9562b74ec1', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:21:55.539346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-630131af-77bd-4372-86a0-a04884aaba26 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] HTTP exception thrown: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-630131af-77bd-4372-86a0-a04884aaba26 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Request method failure captured: Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 HTTP/1.1 Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedUeUdZrPGa9fgqhjYpLy4wXBK0-1eEQe7S8JUuQkIpewQ9Uwe8dG8rMU2bl6nEqVkFOhpi2Qke8xIUKU4WD_J9A7VvLZO9WOjd5fmAODgWFq_FbsWkegZdte0mKw7aA9XYaQwRjlfDergmqn7dnPDlRvzO8z5S-AsrF6iKpS1bf6g Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:21:55.541271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 04c46460cf0c478fbf21499f6cceaf65 Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '1373ad7d-024b-4933-8c6e-92fd221b4f95'} Oct 05 20:21:55.542531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. (HTTP 404) (Request-ID: req-107bd0fb-e514-43e5-958f-8067eabf116f) Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.543357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 20:21:55.544302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 20:21:55.545749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-630131af-77bd-4372-86a0-a04884aaba26 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Returning 404 to user: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-630131af-77bd-4372-86a0-a04884aaba26 tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 404 len: 109 microversion: 2.1 time: 0.107441 Oct 05 20:21:55.546907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 10/18] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:21:55 2022] DELETE /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:21:55.556137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3506a8fe-7c32-4e7a-bd7e-e37d358c6b7b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Calling method '.version_select at 0x7f3e0344e820>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:55.787757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-3506a8fe-7c32-4e7a-bd7e-e37d358c6b7b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] HTTP exception thrown: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3506a8fe-7c32-4e7a-bd7e-e37d358c6b7b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Request method failure captured: Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 HTTP/1.1 Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedUeUdZrPGa9fgqhjYpLy4wXBK0-1eEQe7S8JUuQkIpewQ9Uwe8dG8rMU2bl6nEqVkFOhpi2Qke8xIUKU4WD_J9A7VvLZO9WOjd5fmAODgWFq_FbsWkegZdte0mKw7aA9XYaQwRjlfDergmqn7dnPDlRvzO8z5S-AsrF6iKpS1bf6g Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:21:55.789862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/fbc6ca1549a6487cbcbc8ef395cbc801"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: fbc6ca1549a6487cbcbc8ef395cbc801 Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1153493429 Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 04c46460cf0c478fbf21499f6cceaf65 Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1153493429-project Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '1373ad7d-024b-4933-8c6e-92fd221b4f95'} Oct 05 20:21:55.791078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. (HTTP 404) (Request-ID: req-e4ff18ce-322d-419b-9bda-7e402fc4bfae) Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.791779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:21:55.792778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 20:21:55.793815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. Oct 05 20:21:55.794768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:21:55.797818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3506a8fe-7c32-4e7a-bd7e-e37d358c6b7b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] Returning 404 to user: Volume 1373ad7d-024b-4933-8c6e-92fd221b4f95 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:21:55.798834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3506a8fe-7c32-4e7a-bd7e-e37d358c6b7b tempest-VolumesSnapshotsTestJSON-1153493429 tempest-VolumesSnapshotsTestJSON-1153493429-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95" status: 404 len: 109 microversion: 2.1 time: 0.247122 Oct 05 20:21:55.802698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 11/19] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:21:55 2022] GET /compute/v2.1/os-volumes/1373ad7d-024b-4933-8c6e-92fd221b4f95 => generated 109 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:21:57.831371 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9bf2a6d6-786e-408c-99e4-8eb46b4be85c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'create', calling method: .version_select at 0x7f3e0344e3a0>, body: {"keypair": {"name": "tempest-keypair-1073248308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCs+/k/hcr5dObwYjD/NJEFxvhaI3CCFy5URo/zJbPvlCJRN/o09SsTGrwZAjTFLsKUpdZgNdlcyWXlbbf/venWHZYT4uamLt8ycpwF747fz8/ZHV9Gle47zqWFjpBnSDQ=="}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:21:57.987815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-9bf2a6d6-786e-408c-99e4-8eb46b4be85c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'key_pairs'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:21:58.018286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-9bf2a6d6-786e-408c-99e4-8eb46b4be85c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for user ff9b14ab630d4a928614c60e6aea667c and project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'key_pairs'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:21:58.155261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9bf2a6d6-786e-408c-99e4-8eb46b4be85c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.981785 Oct 05 20:21:58.165045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 12/20] 10.222.0.23 () {62 vars in 1200 bytes} [Wed Oct 5 20:21:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 993 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 20:21:59.482259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:21:59.484393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:21:59.485054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:21:59.485715 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:21:59.486300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:21:59.517213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:21:59.526691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:21:59.531473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:21:59.532521 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:21:59.533190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:21:59.534835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:21:59.620257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for project 07f868da50254a68bc692bca433d2699. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:21:59.637954 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for user 1301a78c1a684c94acb9f26b56f39f21 and project 07f868da50254a68bc692bca433d2699. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:21:59.659480 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:21:59.662521 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:21:59.798422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4c8f4716-36f2-448b-987e-624b4c95dbb1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.051640 Oct 05 20:21:59.799427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 9/21] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:21:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 5053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:21:59.811400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f9eef642-af5b-400f-a83d-d96263928f19 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:21:59.812780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f9eef642-af5b-400f-a83d-d96263928f19 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:21:59.984832 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f9eef642-af5b-400f-a83d-d96263928f19 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:00.014863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f9eef642-af5b-400f-a83d-d96263928f19 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1221 microversion: 2.1 time: 0.204653 Oct 05 20:22:00.015960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 13/22] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:21:59 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1221 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:00.348949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2075251943", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:00.494909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] validate_networks() for [('cc456dbc-ea96-4537-b89e-3b9562b74ec1', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:22:02.616078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:22:02.616665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:22:02.619322 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:22:02.619792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:22:02.620222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:22:02.649351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:02.651191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:02.651651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:02.652408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:02.655999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:02.657538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:02.742909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for project 07f868da50254a68bc692bca433d2699. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:22:02.759269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for user 1301a78c1a684c94acb9f26b56f39f21 and project 07f868da50254a68bc692bca433d2699. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:22:02.802129 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:22:02.807291 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:22:02.974693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5ad0b82b-b6ef-4733-9700-02c16e144816 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.632252 Oct 05 20:22:02.975711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 10/23] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:22:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 2634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:22:03.284395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1100435388", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "networks": [{"uuid": "b6dd4416-41b5-479a-a76a-dc7fca48e400"}]}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:03.455042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] validate_networks() for [('b6dd4416-41b5-479a-a76a-dc7fca48e400', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:22:04.313758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-223370e8-31ae-4e44-9457-caa7afdc05c5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: .version_select at 0x7f3e02b24700>, body: {"keypair": {"name": "tempest-keypair-1994082307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBphb3mPU3FclR54ooTco/4Ry57iT/tjv8ucd3ftJmw8sX4Xjw4Cqypgw7W2sNzCgfLbziNG9rvglHDIipBAGlgMCseWNfsQaEP3dGWCmHWVDzI2CRO6tyzRm9+Kf31/2g=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:04.418259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-223370e8-31ae-4e44-9457-caa7afdc05c5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:22:04.435115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-223370e8-31ae-4e44-9457-caa7afdc05c5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for user c28866ff5b2a4dd4ba05270b369f064e and project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:22:04.549476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-223370e8-31ae-4e44-9457-caa7afdc05c5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.569829 Oct 05 20:22:04.554087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 11/24] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:22:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:04.572396 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-626a408a-a93d-411f-b732-298f61a8a8ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:04.573036 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-626a408a-a93d-411f-b732-298f61a8a8ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:04.837538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-626a408a-a93d-411f-b732-298f61a8a8ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:04.911243 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-626a408a-a93d-411f-b732-298f61a8a8ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1222 microversion: 2.1 time: 0.347163 Oct 05 20:22:04.911907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 12/25] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:04 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1222 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:05.941413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:05.944017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:05.967161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:05.971891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:05.981531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:05.984839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:05.986642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:05.989448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:06.863657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:06.893958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9b7e9c1b-5eb1-4b5b-9082-d432c0f0505f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1282 microversion: 2.1 time: 0.958880 Oct 05 20:22:06.897191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 13/26] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:05 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1282 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:07.221593 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:22:07.222167 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:22:07.222496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:22:07.222906 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:22:07.223344 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:22:07.255936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:07.261750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:07.263192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:07.268831 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:07.269338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:07.269843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:07.279412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1107380938", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f57b2de0-9b37-423e-9981-d689d8abf0c3"}], "security_groups": [{"name": "tempest-securitygroup--1977379871"}], "key_name": "tempest-keypair-1073248308", "user_data": "}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:07.367437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Getting quotas for project 38145c704ac548abb6747e073892ff72. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:22:07.389801 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Getting quotas for user a553cd4c2e154ee1979812ae575e6fb2 and project 38145c704ac548abb6747e073892ff72. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:22:07.437372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:22:07.449196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:22:07.621144 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ca51b5fb-71e3-48d6-aa38-14ca0cfb6427 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.327501 Oct 05 20:22:07.631149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 14/27] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:22:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 5338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:22:07.673305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c987e7ff-2cee-4cdb-bee5-ee4d25c6bbbc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:07.680263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c987e7ff-2cee-4cdb-bee5-ee4d25c6bbbc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:08.081187 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c987e7ff-2cee-4cdb-bee5-ee4d25c6bbbc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:08.088749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c987e7ff-2cee-4cdb-bee5-ee4d25c6bbbc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1215 microversion: 2.1 time: 0.456057 Oct 05 20:22:08.089722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 15/28] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:07 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1215 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:08.106940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:08.106940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:08.147200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:08.148385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:08.151237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:08.156329 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:08.159283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:08.160651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:08.215964 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] validate_networks() for [('f57b2de0-9b37-423e-9981-d689d8abf0c3', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:22:08.724260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:08.755911 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-243f9a26-dbce-4a1a-b258-a12fff4b189f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1280 microversion: 2.1 time: 0.661615 Oct 05 20:22:08.792134 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 16/29] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:08 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1280 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:09.116923 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:09.121691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:09.131046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:09.131553 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:09.151507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:09.152922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:09.156645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:09.158929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:09.367331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:09.377435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0e1a378e-eeec-4d33-a6a1-4075b8a9b72e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1219 microversion: 2.1 time: 0.264617 Oct 05 20:22:09.391553 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 17/30] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:09 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1219 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:09.799205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:09.800479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:09.809184 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:09.819447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:09.820071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:09.820976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:09.821607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:09.822210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:10.089148 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:10.107872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2e765c9d-feb4-4e54-bae3-efc61ae7f9f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1280 microversion: 2.1 time: 0.305081 Oct 05 20:22:10.108580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 18/31] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:09 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1280 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:10.251782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:22:10.252276 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:22:10.252690 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:22:10.253193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:22:10.253631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:22:10.276075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:10.276574 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:10.277297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:10.278760 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:10.280474 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:10.280919 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:10.323239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:22:10.334173 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for user ff9b14ab630d4a928614c60e6aea667c and project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:22:10.392541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:22:10.402537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:22:10.403745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:10.404560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:10.413797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:10.415662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:10.418519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:10.421949 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:10.422442 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:10.423019 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:10.511547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-53e39419-9174-405d-940b-d37cd6b01f5d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.258396 Oct 05 20:22:10.512706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 14/32] 10.222.0.23 () {62 vars in 1188 bytes} [Wed Oct 5 20:22:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 3260 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 20:22:10.524018 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1311970231", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "befb067e-a787-4f3b-9756-b797371b0a4e"}], "security_groups": [{"name": "tempest-securitygroup--892635259"}], "key_name": "tempest-keypair-1994082307", "user_data": "}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:10.665203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:10.676446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c8fee7f9-bd8c-4f02-aa43-f6f40e224606 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1219 microversion: 2.1 time: 0.276809 Oct 05 20:22:10.690714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 19/33] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:10 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1219 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:10.703330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-70d201c4-ad37-47ed-b7bb-5ff0988e923a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:10.703822 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-70d201c4-ad37-47ed-b7bb-5ff0988e923a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:10.768092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-70d201c4-ad37-47ed-b7bb-5ff0988e923a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:10.779879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-70d201c4-ad37-47ed-b7bb-5ff0988e923a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:10.781663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-70d201c4-ad37-47ed-b7bb-5ff0988e923a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:10.783166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-70d201c4-ad37-47ed-b7bb-5ff0988e923a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1282 microversion: 2.20 time: 0.091138 Oct 05 20:22:10.784117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 20/34] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:10 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:11.092778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] validate_networks() for [('befb067e-a787-4f3b-9756-b797371b0a4e', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:22:11.131996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:11.132752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:11.141273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:11.142191 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:11.143195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:11.144437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:11.145122 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:11.145933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:11.490107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:11.502797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d2d3d03c-eef5-4a78-bb94-e7f5c95055fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.375202 Oct 05 20:22:11.504158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 21/35] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:11 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:11.706754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:11.707448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:11.718577 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:11.721930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:11.722407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:11.723367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:11.726236 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:11.735604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:11.841555 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:22:11.842836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:22:11.843520 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:22:11.844101 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:22:11.844692 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:22:11.865387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:11.866251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:11.866884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:11.871899 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:11.873347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:11.881569 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:11.929935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:22:11.939493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for user c28866ff5b2a4dd4ba05270b369f064e and project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:22:11.980008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:22:11.984333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:22:12.064433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:12.104936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-da92ba1f-cf2c-456b-915f-a1d21393f745 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.576394 Oct 05 20:22:12.106860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 15/36] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:22:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:22:12.118946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:12.119490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:12.139768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:12.148327 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b5d1067f-9e30-45ee-b964-fed4d67f6cce tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1219 microversion: 2.1 time: 0.445582 Oct 05 20:22:12.157280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:12.158165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:12.159656 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:12.162006 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:12.163421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:12.172000 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 22/37] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:11 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1219 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:12.206741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-053ac598-d21b-4e52-9cc7-d39524dfafea tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:12.207494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-053ac598-d21b-4e52-9cc7-d39524dfafea tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:12.385204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:12.404515 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:12.406763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:12.411114 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-783c6331-77fb-4493-ac9d-47d39d733849 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1286 microversion: 2.20 time: 0.301304 Oct 05 20:22:12.427912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 16/38] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:12 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1286 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:12.519233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-053ac598-d21b-4e52-9cc7-d39524dfafea tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:12.529778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-053ac598-d21b-4e52-9cc7-d39524dfafea tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1238 microversion: 2.1 time: 0.355972 Oct 05 20:22:12.534892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:12.535990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:12.539506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 23/39] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:12 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1238 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:12.580942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:12.582946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:12.587210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:12.588417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:12.588898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:12.589342 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:13.178063 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:13.179083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:13.204255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:13.205981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:13.208251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:13.215510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:13.217368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:13.220307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:13.624783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:13.646373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-28f543eb-b550-4563-b0fc-ddf99a7173b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1267 microversion: 2.1 time: 0.473963 Oct 05 20:22:13.665544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 24/40] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:13 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1267 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:13.683006 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:13.684315 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:13.707845 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:13.725855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:13.727880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:13.728896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:13.730200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:13.730989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:13.877652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:13.898774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:13.907043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:13.909646 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-90da0d1d-7881-412a-9128-85ad0679aceb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1278 microversion: 2.20 time: 0.248055 Oct 05 20:22:13.911909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 25/41] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:13 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:13.933015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:13.935980 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:13.954050 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:13.955962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:13.958260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:13.960741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:13.963009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:13.965471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:14.194423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:14.221161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-55f29573-7b70-4dce-b279-ec14076e9c7b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1242 microversion: 2.1 time: 0.295313 Oct 05 20:22:14.225250 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 26/42] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:13 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1242 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:14.691160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:14.692180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:14.702185 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:14.702734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:14.728136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:14.729375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:14.734900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:14.738219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:14.896702 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:14.905893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2e0c1e7d-fafe-4e9f-b9e9-280d9c2349fe tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 2.378101 Oct 05 20:22:14.920333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 17/43] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:12 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 2394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:14.940342 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:14.943415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:14.961080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:14.962121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:14.963172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:14.964145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:14.966033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:14.967055 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:15.232840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:15.246939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-16db58cc-cbbe-42c0-a770-5546f6b69e3e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1273 microversion: 2.1 time: 0.562747 Oct 05 20:22:15.248678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 27/44] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:14 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1273 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:15.255414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:15.256372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:15.277200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:15.278285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:15.280154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:15.281397 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:15.282655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:15.283651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:15.294414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:15.313036 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:15.319026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:15.320476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5ecb08e1-f9de-4948-b835-b1eb85898fe4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1334 microversion: 2.20 time: 0.384313 Oct 05 20:22:15.326535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 18/45] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:14 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1334 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:15.412056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:15.446407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-317a813f-9468-485e-9243-345cd3eba929 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1234 microversion: 2.1 time: 0.187480 Oct 05 20:22:15.447374 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 28/46] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:15 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1234 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:15.944172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:15.946382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:15.958360 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:15.961123 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:15.962099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:15.962991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:15.963868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:15.967608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:16.275806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:16.276669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:16.294248 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:16.295803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:16.296484 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:16.297845 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:16.300507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:16.301960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:16.562123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:16.606669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1b59962f-d7d0-4c10-8975-7602c7c15845 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1273 microversion: 2.1 time: 0.333102 Oct 05 20:22:16.625731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 29/47] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:16 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1273 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:16.627733 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:16.628720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:16.650547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:16.651509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:16.653042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:16.654919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:16.677358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:16.679773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:16.776787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:16.788341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8bb9625b-53af-4b42-96d4-ccc81f2a4259 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.848002 Oct 05 20:22:16.790928 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 19/48] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:15 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:16.803705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:16.804869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:16.821274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:16.823302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:16.825946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:16.830652 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:16.832728 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:16.834579 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.056937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:17.067344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:17.071825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:17.076530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:17.077289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9d8ac9c9-8b9d-4f3a-9f6a-8a63acb137c1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1234 microversion: 2.1 time: 0.285122 Oct 05 20:22:17.080395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-059e03d5-eead-4d90-bdb6-2120ed4541bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1334 microversion: 2.20 time: 0.462902 Oct 05 20:22:17.082118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 30/49] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:16 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1334 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:17.086405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 20/50] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:16 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1234 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:17.599511 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:17.649647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:17.650532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:17.657550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.657550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.657785 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.658522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.659048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.659664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.814956 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb4e1864-19fb-435d-ac75-675b0bf645c4", "tag": "29d8ca08-27f5-4d47-969a-f9e88617fde0"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:17.829866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:17.840202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-fa7a1227-946f-46db-b539-bbd9f46ef1b7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.194333 Oct 05 20:22:17.845943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.845943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.845943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.850043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 21/51] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:17 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:17.851491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:17.857416 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:17.860593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:17.869734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.870244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.870923 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.871944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.873327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.874198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.886616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Creating event network-changed:29d8ca08-27f5-4d47-969a-f9e88617fde0 for instance fb4e1864-19fb-435d-ac75-675b0bf645c4 on hv-cinder-80152 Oct 05 20:22:17.887141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 20:22:17.887527 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f173dce9-58db-46cc-8451-2e6ed04bd948 req-1e07f07f-40b4-40e1-b0f3-074b5710aff1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 20:22:17.888592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.889447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.889912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.890872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:17.891473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:17.892040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:17.902494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.compute.rpcapi [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 20:22:17.903633 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] Releasing lock "compute-rpcapi-router" {{(pid=120351) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 20:22:17.924647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c15cafc5-9a04-428d-8d85-3bd72fe374d4 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330111 Oct 05 20:22:17.925483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 31/52] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:18.042219 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:18.051429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-41227898-c631-4b9d-9927-701266cd18ed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.203347 Oct 05 20:22:18.052212 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 22/53] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:17 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:18.118921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:18.119786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:18.127609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:18.128194 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:18.129752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:18.130198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:18.130598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:18.131401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:18.131881 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:18.132496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:18.137473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:18.138179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:18.138936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:18.139812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:18.140296 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:18.140722 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:18.236488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:18.257846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-80f0df56-f77f-46c5-b960-2f9f8fbeb265 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1234 microversion: 2.1 time: 0.142882 Oct 05 20:22:18.258886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 32/54] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:18 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1234 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:18.307400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:18.328632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:18.355604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:18.361207 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f3938052-6caf-4872-b03f-d0fd1cb86274 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1334 microversion: 2.20 time: 0.236300 Oct 05 20:22:18.373988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 23/55] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:18 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1334 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:18.872545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:18.873914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:18.886614 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:18.887464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:18.890815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:18.892086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:18.892768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:18.896895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.078260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:19.079258 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:19.103485 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.104869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.108185 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.109130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.112764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.114230 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.193112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:19.208409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e6c7d001-3551-424f-8e2d-f07d9f739e29 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.342287 Oct 05 20:22:19.210312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 33/56] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:18 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:19.283207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:19.283933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:19.301801 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.308957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.311157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.313755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.317764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.318322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.393470 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:19.475028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:19.487921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3169078a-53bc-4877-bb1d-4c7ee14a1a3c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1234 microversion: 2.1 time: 0.207262 Oct 05 20:22:19.488781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 34/57] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:19 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1234 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:19.500395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:19.505074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:19.531610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.534385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.534813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.540230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.540660 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.543528 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:19.708131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:19.762633 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:19.768135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:19.769312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6d11432b-91a3-4d1a-8339-5e8c45121efc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1334 microversion: 2.20 time: 0.279653 Oct 05 20:22:19.793338 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:19.793860 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 35/58] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:19 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1334 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:19.809031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8dbf28e3-16f2-4ea6-a3c0-b2eabd0d669e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.736233 Oct 05 20:22:19.824023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 24/59] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:19 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:19.944803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-eb5facbe-a48c-4a5d-a993-3a0d85529e37 req-3466c0c0-60ab-47f1-a9f8-a113feabf502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4856b5d-d049-4ee8-9b69-ba630f8d128f", "tag": "d4537d2a-eb74-46f9-a32b-750a8bc9692c"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:19.964326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-eb5facbe-a48c-4a5d-a993-3a0d85529e37 req-3466c0c0-60ab-47f1-a9f8-a113feabf502 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:19.967871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-eb5facbe-a48c-4a5d-a993-3a0d85529e37 req-3466c0c0-60ab-47f1-a9f8-a113feabf502 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:19.968475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-eb5facbe-a48c-4a5d-a993-3a0d85529e37 req-3466c0c0-60ab-47f1-a9f8-a113feabf502 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:20.015452 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-eb5facbe-a48c-4a5d-a993-3a0d85529e37 req-3466c0c0-60ab-47f1-a9f8-a113feabf502 service nova] Creating event network-changed:d4537d2a-eb74-46f9-a32b-750a8bc9692c for instance f4856b5d-d049-4ee8-9b69-ba630f8d128f on hv-cinder-80152 Oct 05 20:22:20.043550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-eb5facbe-a48c-4a5d-a993-3a0d85529e37 req-3466c0c0-60ab-47f1-a9f8-a113feabf502 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103402 Oct 05 20:22:20.044084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 36/60] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:22:20.237546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:20.238208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:20.261617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:20.265342 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:20.265981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:20.268445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:20.269924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:20.271041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:20.523287 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:20.525175 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:20.535958 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:20.538803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:20.541195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:20.542530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:20.543252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:20.545887 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:20.882115 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:20.897189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c2a3067f-5d86-4c99-a9f2-6909814130a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1234 microversion: 2.1 time: 0.379891 Oct 05 20:22:20.921031 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 37/61] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:20 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1234 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:20.945312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:20.946005 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:20.976815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:20.977333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:20.977885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:20.984932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:20.985626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:20.986384 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:21.220716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:21.230495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:21.243556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:21.245035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-15d59cf0-7e9f-4b4a-9f51-38b1338f86b1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1334 microversion: 2.20 time: 0.322860 Oct 05 20:22:21.246532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 38/62] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:20 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1334 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:21.256450 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:21.266402 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:21.272990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:21.273872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:21.285782 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:21.286720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:21.287183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:21.287771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:21.407262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:21.445363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9a421f3a-a3c8-441b-a7f4-f988fde82156 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 1.208876 Oct 05 20:22:21.451483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 25/63] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:20 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:21.923834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:21.924438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:21.926340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=8 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:21.944222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:21.944710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:21.960496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:21.967648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:21.968321 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:21.968978 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:21.969839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=30 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:22.004091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=75 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:22.188557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:22.199371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-71d2fc8d-1951-4122-a436-90c6a1968566 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1290 microversion: 2.1 time: 0.280175 Oct 05 20:22:22.203575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 26/64] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:21 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1290 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:22.280294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:22.280915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:22.298936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:22.299429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:22.299865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:22.300570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:22.301017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:22.301436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:22.312108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:22.326314 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4c34635a-71f8-421c-9d64-5d69f08bb275 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 1.076226 Oct 05 20:22:22.327273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 39/65] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:21 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:22.408998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:22.421411 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:22.427089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:22.428260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-810bb78e-5d16-4616-b942-b6b62aac3ffb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1340 microversion: 2.20 time: 0.157117 Oct 05 20:22:22.430472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 27/66] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:22 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1340 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:22.481114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:22.482756 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:22.494462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:22.494955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:22.495401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:22.509109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:22.509791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:22.510247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:22.549478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=18 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:23.229837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:23.233404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:23.234057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:23.240433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f7f134a4-fd2f-4f9b-99ae-317e8061fc3d tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.762102 Oct 05 20:22:23.241118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 40/67] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:22 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:23.246345 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.247490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.248595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.250269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.251129 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.252325 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.352890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:23.353604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:23.362567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.363390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.364053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.364968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.365661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.366555 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.420343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:23.428135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4f9712cb-13f1-446f-84be-d998d11b0ad0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1296 microversion: 2.1 time: 0.200018 Oct 05 20:22:23.428723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 28/68] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:23 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1296 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:23.456670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:23.457577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:23.471322 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.472132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.472759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.473706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.474340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.474940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.634878 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:23.642890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:23.647426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:23.649944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:23.651574 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-62558a71-6fec-465b-8071-fb64dc69eba0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1340 microversion: 2.20 time: 0.198751 Oct 05 20:22:23.652044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5bc1b6bd-ed37-44fc-8243-a1802af0682e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.302932 Oct 05 20:22:23.652629 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 41/69] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:23 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:23.653089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 29/70] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:23 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1340 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:23.922205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-68c70550-c8b9-4540-8649-8dd0deedfd52 req-83fa5196-994a-4a22-9cf1-fa911d4f2f2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a10e8a38-b20d-4dde-8f5f-566740f633fc", "tag": "afe64fa3-44ab-44b3-a977-349ea8ab76cc"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:23.934090 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-68c70550-c8b9-4540-8649-8dd0deedfd52 req-83fa5196-994a-4a22-9cf1-fa911d4f2f2f service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:23.935535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-68c70550-c8b9-4540-8649-8dd0deedfd52 req-83fa5196-994a-4a22-9cf1-fa911d4f2f2f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:23.936154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-68c70550-c8b9-4540-8649-8dd0deedfd52 req-83fa5196-994a-4a22-9cf1-fa911d4f2f2f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:23.951798 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-68c70550-c8b9-4540-8649-8dd0deedfd52 req-83fa5196-994a-4a22-9cf1-fa911d4f2f2f service nova] Creating event network-changed:afe64fa3-44ab-44b3-a977-349ea8ab76cc for instance a10e8a38-b20d-4dde-8f5f-566740f633fc on hv-cinder-80152 Oct 05 20:22:23.957870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-68c70550-c8b9-4540-8649-8dd0deedfd52 req-83fa5196-994a-4a22-9cf1-fa911d4f2f2f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.296862 Oct 05 20:22:23.958569 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 42/71] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:24.264780 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:24.265400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:24.271476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.271979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.272418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.274221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.274708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.275143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.458388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:24.460105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:24.464961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:24.471566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.472460 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.473109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.474177 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.474964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.475579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.627496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:24.641945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f077fe86-6361-48e4-a450-16d9f5d259bc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1296 microversion: 2.1 time: 0.188409 Oct 05 20:22:24.658271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 43/72] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:24 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:24.677729 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:24.678468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:24.690320 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.691988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.692679 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.694757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.695655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.696572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.920195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:24.949155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e09c08f5-7b39-4759-8128-cd67d4cb57b0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.688779 Oct 05 20:22:24.949953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 30/73] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:24 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:24.961169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:24.970279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:24.989982 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.990523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.992060 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:24.995104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:24.995592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:24.996259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:25.130584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:25.138254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-30036b13-d8a5-4a57-a51e-05b2c192c0a1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.465479 Oct 05 20:22:25.150474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 44/74] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:24 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:25.433292 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:25.446641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:25.450330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:25.453376 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ccb616af-8ca5-4037-b6e2-d2aec9fe7294 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.502402 Oct 05 20:22:25.456174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 31/75] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:24 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:25.674139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:25.674870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:25.689973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:25.690745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:25.691420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:25.692582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:25.697337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:25.698039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:25.976535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:25.977460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:25.988739 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:25.989439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:25.990058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:25.990911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:25.992909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:25.993539 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:26.045797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:26.055672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7153aff9-20f8-4b0a-958e-599461311e85 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.388068 Oct 05 20:22:26.056804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 45/76] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:25 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:26.166635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:26.167268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:26.180127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:26.180629 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:26.186282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:26.187288 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:26.189141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:26.190321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:26.501585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:26.503715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:26.512518 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1794026e-1411-4f12-bdcb-5c532bfe6cf4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.353307 Oct 05 20:22:26.516630 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2c742679-4ff1-4e5b-8370-e41663cada38 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.544091 Oct 05 20:22:26.526760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 46/77] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:26 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:26.547038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-1565eb97-a98f-4a0d-ad9e-d6ecf7b20ace req-ca64342d-869a-44ef-99a7-3138974b0038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:26.547229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 32/78] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:25 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:26.556195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:26.569261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:26.584978 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:26.586014 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:26.588329 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1565eb97-a98f-4a0d-ad9e-d6ecf7b20ace req-ca64342d-869a-44ef-99a7-3138974b0038 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:26.588954 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:26.589894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:26.590153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1565eb97-a98f-4a0d-ad9e-d6ecf7b20ace req-ca64342d-869a-44ef-99a7-3138974b0038 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:26.590607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1565eb97-a98f-4a0d-ad9e-d6ecf7b20ace req-ca64342d-869a-44ef-99a7-3138974b0038 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:26.591308 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:26.592025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:26.618571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-1565eb97-a98f-4a0d-ad9e-d6ecf7b20ace req-ca64342d-869a-44ef-99a7-3138974b0038 service nova] Creating event network-changed:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:22:26.631209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-1565eb97-a98f-4a0d-ad9e-d6ecf7b20ace req-ca64342d-869a-44ef-99a7-3138974b0038 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099081 Oct 05 20:22:26.631819 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 47/79] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:26.847613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:26.856227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:26.858446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:26.859547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9bea5c5a-771c-4de5-a94f-3e04aa57a878 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.311182 Oct 05 20:22:26.860085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 33/80] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:26 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:27.110048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:27.116740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:27.156089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:27.160811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:27.161475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:27.162632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:27.167504 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:27.172827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:27.539454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:27.541004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:27.551305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:27.554738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:27.555351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:27.556231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:27.558027 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:27.561920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:27.900907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:28.017295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:28.018159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:28.037172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3f6310cc-f229-4d9c-a385-5538687abf41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.502223 Oct 05 20:22:28.040117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7bfbaf5c-1d87-4d32-a6a7-a49083370fff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.939723 Oct 05 20:22:28.041235 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 34/81] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:27 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:28.044909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 48/82] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:27 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:28.061579 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:28.066288 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:28.067604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:28.071891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:28.076898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.077847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.078577 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.079663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.080345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.081004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.093805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.094720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.097584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.098569 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.099239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.102294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.472549 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:28.483324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ae48fd62-9ab4-4eb8-a547-7fe786d0cadc tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.439314 Oct 05 20:22:28.483900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 35/83] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:28 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:28.502836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc97e634-82d8-4433-bee0-6d00f84075e7", "tag": "0b7637cb-b026-4f28-9263-f8fb7d10f2e2"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:28.524187 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:28.528969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.529453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.530199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.536972 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:28.538574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:28.544583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-64c725b0-21fa-40ed-a8e0-da8370db73e6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.498376 Oct 05 20:22:28.545493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 49/84] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:28 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:28.587204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Creating event network-changed:0b7637cb-b026-4f28-9263-f8fb7d10f2e2 for instance cc97e634-82d8-4433-bee0-6d00f84075e7 on hv-cinder-80152 Oct 05 20:22:28.587750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 20:22:28.588115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a1c38f5f-bff6-4e5b-b875-e50887233e95 req-bc435f98-c9ea-45b6-ba5d-427e56bb8169 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 20:22:28.590097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.591673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.592335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.593470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:28.594885 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:28.595642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:28.628720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.compute.rpcapi [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 20:22:28.634331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] Releasing lock "compute-rpcapi-router" {{(pid=120350) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 20:22:28.665092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2b509e79-0c63-47b7-8df1-591b737ccc20 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179975 Oct 05 20:22:28.665847 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 36/85] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:29.078061 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:29.080214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:29.081088 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:29.083187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:29.099953 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.104799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.105396 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.106263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.108670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.110258 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.110409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.111991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.112967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.113458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.114842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.115460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.301960 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:29.314365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-85bd90a2-ac65-4f46-a8f6-e1c89e7f8885 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.248830 Oct 05 20:22:29.333765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 37/86] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:29 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:29.481295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:29.498677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c7ac7207-ed3c-42dc-a818-9a2c3bebc2db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.433079 Oct 05 20:22:29.500405 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 50/87] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:29 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:29.517957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:29.520740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:29.537630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.539186 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.539875 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.543510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.545284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.547785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.687618 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-c300f85c-f09e-461d-a32c-d6f66b62b371 req-9d9324f7-0cf2-466c-b107-889c23dd039a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4856b5d-d049-4ee8-9b69-ba630f8d128f", "name": "network-vif-plugged", "status": "completed", "tag": "d4537d2a-eb74-46f9-a32b-750a8bc9692c"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:29.698608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c300f85c-f09e-461d-a32c-d6f66b62b371 req-9d9324f7-0cf2-466c-b107-889c23dd039a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.699091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c300f85c-f09e-461d-a32c-d6f66b62b371 req-9d9324f7-0cf2-466c-b107-889c23dd039a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.699522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c300f85c-f09e-461d-a32c-d6f66b62b371 req-9d9324f7-0cf2-466c-b107-889c23dd039a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.712034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-c300f85c-f09e-461d-a32c-d6f66b62b371 req-9d9324f7-0cf2-466c-b107-889c23dd039a service nova] Creating event network-vif-plugged:d4537d2a-eb74-46f9-a32b-750a8bc9692c for instance f4856b5d-d049-4ee8-9b69-ba630f8d128f on hv-cinder-80152 Oct 05 20:22:29.718454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-c300f85c-f09e-461d-a32c-d6f66b62b371 req-9d9324f7-0cf2-466c-b107-889c23dd039a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269259 Oct 05 20:22:29.718876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 38/88] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:29.730360 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:29.731119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:29.738539 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.739300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.739901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.740991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:29.741659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:29.742258 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:29.798789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:29.807728 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a4c45c6b-ed3e-499d-beb2-c63f88f6ce30 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.299217 Oct 05 20:22:29.808316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 51/89] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:29 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:29.952880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:29.961247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:29.962820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:29.963972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c4eb0767-7420-4c4b-a716-c14e869a5ae1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.243992 Oct 05 20:22:29.973917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 39/90] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:29 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:30.343728 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:30.344713 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:30.356486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:30.357388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:30.359132 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:30.360980 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:30.361736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:30.365103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:30.523499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:30.524356 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:30.535125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:30.535813 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:30.536446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:30.541352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:30.542158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:30.542962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:30.816249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:30.828908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7c65fa21-5589-4a62-b33d-1c5c4691de34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.488894 Oct 05 20:22:30.831302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 52/91] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:30 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:30.860377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:30.861041 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:30.882804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:30.884049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:30.884732 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:30.886206 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:30.886974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:30.888068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:30.898365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:30.978016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:30.995783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c8f473b4-f3aa-4040-a617-722c49a3d570 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.472209 Oct 05 20:22:31.006797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 40/92] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:30 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:31.021143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:31.022328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:31.034309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:31.035048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:31.035789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:31.037370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:31.038079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:31.038770 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:31.099350 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:31.107275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2b2f5af0-87e4-4f67-90f0-791ec8cf1ad0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.274211 Oct 05 20:22:31.108377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 53/93] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:30 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:31.216388 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:31.225880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:31.227511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:31.228753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5b518280-8f09-4374-894b-9f6d0a33b3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.220782 Oct 05 20:22:31.229500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 41/94] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:31 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:31.734026 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-d1f7597f-80cd-4c2a-becd-da2713b6ccb9 req-4caf6b8a-058b-48b1-8d2a-95fe3fbc2ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4e1864-19fb-435d-ac75-675b0bf645c4", "name": "network-vif-plugged", "status": "completed", "tag": "29d8ca08-27f5-4d47-969a-f9e88617fde0"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:31.743234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d1f7597f-80cd-4c2a-becd-da2713b6ccb9 req-4caf6b8a-058b-48b1-8d2a-95fe3fbc2ac6 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:31.743720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d1f7597f-80cd-4c2a-becd-da2713b6ccb9 req-4caf6b8a-058b-48b1-8d2a-95fe3fbc2ac6 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:31.744158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d1f7597f-80cd-4c2a-becd-da2713b6ccb9 req-4caf6b8a-058b-48b1-8d2a-95fe3fbc2ac6 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:31.756153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-d1f7597f-80cd-4c2a-becd-da2713b6ccb9 req-4caf6b8a-058b-48b1-8d2a-95fe3fbc2ac6 service nova] Creating event network-vif-plugged:29d8ca08-27f5-4d47-969a-f9e88617fde0 for instance fb4e1864-19fb-435d-ac75-675b0bf645c4 on hv-cinder-80152 Oct 05 20:22:31.761469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-d1f7597f-80cd-4c2a-becd-da2713b6ccb9 req-4caf6b8a-058b-48b1-8d2a-95fe3fbc2ac6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031583 Oct 05 20:22:31.762283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 54/95] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:31.862129 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:31.868740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:31.883076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:31.884501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:31.884952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:31.886538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:31.887244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:31.888408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.019464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:32.024049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:32.024738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:32.027002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-181a2335-79b9-4652-915e-ec64b0293999 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.169244 Oct 05 20:22:32.027572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 42/96] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:31 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:32.030907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:32.031387 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:32.031822 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.032507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:32.032953 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:32.033372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.131202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:32.131888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:32.141744 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:32.142381 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:32.142931 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.143710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:32.144283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:32.145082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.171859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:32.179838 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-18bc2d7d-4f50-4824-ac7b-30c9d0b00f86 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.159809 Oct 05 20:22:32.182663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 55/97] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:32 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:32.255098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:32.255743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:32.263616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:32.276637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:32.277281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.281407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:32.281928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:32.287678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:32.317655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:32.320977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:32.332498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4ca24c61-6a62-48db-b246-c21f4d68d6c0 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.204875 Oct 05 20:22:32.334708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 43/98] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:32 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:32.498049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:32.509601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:32.517099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:32.518383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1539b3b4-ae2a-48e8-a207-a600a17ac078 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.267221 Oct 05 20:22:32.529551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 56/99] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:32 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:33.050010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:33.051209 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:33.057440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.057943 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.058564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.059275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.059917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.060891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.207520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:33.208346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:33.218214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.218802 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.219461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.221693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.222217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.222776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.249298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:33.262124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9f93266f-f6e2-4355-8194-676c2fb168bd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.215936 Oct 05 20:22:33.264191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 44/100] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:33 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:33.358500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:33.359328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:33.365252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.365922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.366567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.367891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.368544 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.369473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.387332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:33.395625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4583b2fa-a663-47d6-99bd-fd1ddfef08aa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.195638 Oct 05 20:22:33.397322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 57/101] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:33 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:33.543644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:33.544447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:33.551377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.551926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.552540 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.553446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.554174 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.554733 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.577822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:33.588753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7d81f7d8-54c1-4b36-9465-37861c14ae79 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.234083 Oct 05 20:22:33.600791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 45/102] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:33 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:33.743428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:33.755221 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:33.756944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:33.758374 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b67577f2-b14a-4c47-a9e8-df63f1019989 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.218519 Oct 05 20:22:33.758937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 58/103] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:33 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:33.779344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-d234df3e-6841-4c7d-90bf-e60ea48aad0a req-b74529f8-560c-453e-ad0f-c0df13680d8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a10e8a38-b20d-4dde-8f5f-566740f633fc", "name": "network-vif-plugged", "status": "completed", "tag": "afe64fa3-44ab-44b3-a977-349ea8ab76cc"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:33.789758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-d234df3e-6841-4c7d-90bf-e60ea48aad0a req-b74529f8-560c-453e-ad0f-c0df13680d8f service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:33.789758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-d234df3e-6841-4c7d-90bf-e60ea48aad0a req-b74529f8-560c-453e-ad0f-c0df13680d8f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:33.790107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-d234df3e-6841-4c7d-90bf-e60ea48aad0a req-b74529f8-560c-453e-ad0f-c0df13680d8f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:33.803768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-d234df3e-6841-4c7d-90bf-e60ea48aad0a req-b74529f8-560c-453e-ad0f-c0df13680d8f service nova] Creating event network-vif-plugged:afe64fa3-44ab-44b3-a977-349ea8ab76cc for instance a10e8a38-b20d-4dde-8f5f-566740f633fc on hv-cinder-80152 Oct 05 20:22:33.810036 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-d234df3e-6841-4c7d-90bf-e60ea48aad0a req-b74529f8-560c-453e-ad0f-c0df13680d8f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Oct 05 20:22:33.810649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 46/104] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:34.286400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:34.287645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:34.294517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.295216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.295837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.296699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.297434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.298040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.424149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:34.424861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:34.431069 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.431583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.432016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.432708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.433158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.433600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.539307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:34.549926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4607ae5b-6395-4980-bc42-b1e746cff49a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.265198 Oct 05 20:22:34.551156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 59/105] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:34 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:34.583865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:34.594594 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-53148dcb-d207-4572-b4ad-fe85599d1cfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.175233 Oct 05 20:22:34.595484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 47/106] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:34 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:34.626269 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:34.627061 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:34.635365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.636159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.636787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.638259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.639110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.639786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.786338 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:34.787547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:34.794017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.794727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.795313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.796052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:34.796694 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:34.797256 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:34.807645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:34.816691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bd53abbe-c7db-46b4-8f80-f16578bfe679 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.198103 Oct 05 20:22:34.818570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 60/107] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:34 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:34.948741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:34.957306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:34.959213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:34.960199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5b41de3b-aeac-4c10-b85e-ff5fb209c1fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.178391 Oct 05 20:22:34.961146 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 48/108] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:34 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:35.573728 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:35.574737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:35.581776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:35.582266 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:35.582818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:35.583680 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:35.584505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:35.584945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:35.627807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:35.629727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:35.640142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:35.640876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:35.641646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:35.642862 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:35.643559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:35.644248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:35.734776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:35.743493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-595b7af8-05f8-4019-b48c-e0e5e33918e5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.173818 Oct 05 20:22:35.744167 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 61/109] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:35 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:35.841851 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:35.842575 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:35.848075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:35.849722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:35.850203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:35.850780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:35.851598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:35.852253 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:35.853069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:35.857808 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-17154c67-88ba-4ef5-869d-8b2950fe5ec9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.239745 Oct 05 20:22:35.858759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 49/110] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:35 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:35.991489 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:35.992260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:35.999751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:36.001325 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:36.001943 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:36.002810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:36.003406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:36.004070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:36.091609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:36.102073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6b0a8017-d08c-4d18-afe9-b2adcee46305 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.265495 Oct 05 20:22:36.103197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 62/111] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:35 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:36.174038 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:36.198833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:36.204526 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:36.207119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e1373589-6f6b-41d9-8158-dba25fc223d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.219410 Oct 05 20:22:36.207698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 50/112] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:35 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:36.767564 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:36.768571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:36.774995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:36.775690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:36.776127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:36.776814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:36.777260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:36.777704 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:36.885865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:36.886484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:36.893214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:36.893859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:36.895196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:36.896066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:36.896771 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:36.897369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:36.953760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:36.963307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2dd9df40-e468-4148-9dcc-2eaa116c5fed tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.199124 Oct 05 20:22:36.980114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 63/113] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:36 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:37.042771 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:37.051956 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bd95bc0e-532c-4386-b51f-35826f3252de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.169985 Oct 05 20:22:37.053932 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 51/114] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:36 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:37.125426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:37.126108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:37.132276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:37.132765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:37.133201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:37.133915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:37.134364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:37.134777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:37.238285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:37.238907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:37.246406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:37.247399 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:37.247837 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:37.249074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:37.249850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:37.250571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:37.294060 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:37.303837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d7a5708d-2288-4773-96bf-ed1c716b2881 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.182568 Oct 05 20:22:37.305035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 64/115] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:37 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:37.401092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:37.410582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:37.412337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:37.413718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-eab7cda6-a58e-4031-9a41-6e2f9b0e519d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.181113 Oct 05 20:22:37.414278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 52/116] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:37 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:37.987950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:37.988584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:37.994657 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:37.995156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:37.995677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:37.996298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:37.996743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:37.997200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.076839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:38.077456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:38.083307 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:38.083794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:38.084262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.084961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:38.085421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:38.085955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.172947 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:38.181613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-18713b20-afb0-422b-b3fd-695b0542f778 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.197603 Oct 05 20:22:38.182497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 65/117] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:37 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:38.222479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:38.231610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d17799ab-cb1f-4c02-9a7d-75ab321562d0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.159181 Oct 05 20:22:38.232293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 53/118] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:38 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:38.330346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:38.330974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:38.336740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:38.337221 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:38.337690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.338375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:38.338820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:38.339234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.442385 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:38.443226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:38.449538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:38.450112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:38.450621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.451999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:38.452561 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:38.453182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:38.487186 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:38.495823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b6a84c49-35b3-41fb-bc2d-0449195d8d83 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.169778 Oct 05 20:22:38.498447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 66/119] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:38 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:38.615822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:38.622188 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:38.625891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:38.627370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:38.628473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d660cbf3-ad6b-4347-886a-a683f534a62c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.190391 Oct 05 20:22:38.629032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 54/120] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:38 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:39.206081 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:39.206961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:39.213561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.214130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.214671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.215572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.216771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.217566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.255204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:39.256005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:39.263550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.264328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.264962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.265877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.266556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.267084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.386999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:39.398498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7ee195e4-0c81-44cd-ac29-267a784e6f1c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.196745 Oct 05 20:22:39.400179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 67/121] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:39 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:39.414127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-3633e634-e7e1-4d44-84cb-06988c8df028 req-5ff068e4-e597-420f-827a-b55bd2879a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc97e634-82d8-4433-bee0-6d00f84075e7", "name": "network-vif-plugged", "status": "completed", "tag": "0b7637cb-b026-4f28-9263-f8fb7d10f2e2"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:39.424622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3633e634-e7e1-4d44-84cb-06988c8df028 req-5ff068e4-e597-420f-827a-b55bd2879a7a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.425648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3633e634-e7e1-4d44-84cb-06988c8df028 req-5ff068e4-e597-420f-827a-b55bd2879a7a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.426094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3633e634-e7e1-4d44-84cb-06988c8df028 req-5ff068e4-e597-420f-827a-b55bd2879a7a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.440206 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-3633e634-e7e1-4d44-84cb-06988c8df028 req-5ff068e4-e597-420f-827a-b55bd2879a7a service nova] Creating event network-vif-plugged:0b7637cb-b026-4f28-9263-f8fb7d10f2e2 for instance cc97e634-82d8-4433-bee0-6d00f84075e7 on hv-cinder-80152 Oct 05 20:22:39.447045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-3633e634-e7e1-4d44-84cb-06988c8df028 req-5ff068e4-e597-420f-827a-b55bd2879a7a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045551 Oct 05 20:22:39.448094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 68/122] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:39.458798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:39.469473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a3042c5b-6e39-411c-9171-d802106611c8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.218040 Oct 05 20:22:39.470295 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 55/123] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:39 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:39.523326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:39.524126 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:39.531079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.531695 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.532196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.532951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.533470 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.535535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.654999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:39.655634 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:39.662318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.662318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.662534 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.663380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:39.664157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:39.664712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:39.683313 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:39.691169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d4d99d7b-ac77-4506-859f-a35b1a924b2a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.171988 Oct 05 20:22:39.693560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 69/124] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:39 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:39.807648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:39.816344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:39.818081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:39.819176 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7924fc0d-abd1-49e2-b64e-181395e0a3f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.169449 Oct 05 20:22:39.819722 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 56/125] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:39 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:40.422988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:40.423597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:40.429625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.430142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.430536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.431321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.431672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.432097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.494919 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:40.495496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:40.503471 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.503683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.503965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.504675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.505125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.505563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.669973 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:40.678552 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e290deca-8d53-4eea-9f35-329eca4849b3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.188284 Oct 05 20:22:40.679130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 57/126] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:40 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:40.714844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:40.715451 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:40.722302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.722848 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.723197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.723884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.724335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.724753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.764038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:40.772290 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4d192f66-6ea7-48a7-a026-efe66d667c08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.353632 Oct 05 20:22:40.773089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 70/127] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:40 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:40.845897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:40.848118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:40.855767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.856396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.857586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.858380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:40.858894 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:40.859383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:40.865125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:40.879658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:40.887997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-63c26a3b-d7e4-4f39-a69f-e3c678702364 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.176958 Oct 05 20:22:40.888635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 58/128] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:40 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:41.000547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:41.009044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:41.010497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:41.011586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d9900d86-d746-42bd-842b-bbdd364e0812 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.171096 Oct 05 20:22:41.012138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 71/129] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:40 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:41.702921 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:41.703525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:41.709251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:41.709772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:41.710205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:41.710883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:41.711330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:41.711743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:41.795438 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:41.796161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:41.803082 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:41.803658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:41.804166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:41.804864 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:41.805473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:41.805932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:41.838913 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:41.847082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-98a815ac-3b17-4b22-999a-add70291e881 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.148404 Oct 05 20:22:41.847800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 59/130] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:41 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:41.912316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:41.913276 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:41.923729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:41.924377 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:41.924974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:41.926740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:41.927248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:41.927665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:41.961298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:41.969169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5a334504-5612-4c7c-af4c-af8c95586cd7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1322 microversion: 2.1 time: 0.178047 Oct 05 20:22:41.969755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 72/131] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:41 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:42.036866 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:42.037465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:42.043737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:42.045190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:42.045650 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:42.046344 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:42.046810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:42.047275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:42.102043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:42.110504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-150f042c-754d-4c67-ada3-7fca10a3f158 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.202646 Oct 05 20:22:42.111084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 60/132] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:41 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:42.184656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:42.193894 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:42.195330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:42.196435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-828acfec-4bba-4018-b030-49e7755468d1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.164107 Oct 05 20:22:42.197037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 73/133] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:42 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:42.871165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:42.871844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:42.878314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:42.878802 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:42.879243 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:42.879938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:42.880393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:42.880815 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:42.883394 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:42.992021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:42.992626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:42.998577 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:42.999130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:42.999568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.000247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.000693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.001109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.006260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.013773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-12b5aca9-ea13-4ed1-bb38-1efd1285c5db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.146486 Oct 05 20:22:43.014342 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 61/134] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:42 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:43.129436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.133847 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:43.134461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:43.137053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3d278b2d-4c93-4f8a-a6eb-8d9fa306af05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1515 microversion: 2.1 time: 0.148837 Oct 05 20:22:43.137639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 74/135] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:42 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:43.140313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.140798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.141232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.141957 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.142412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.142834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.160699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:43.163006 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:43.168698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.169875 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.170316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.171004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.171454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.171876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.231565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'flavor' on Instance uuid fb4e1864-19fb-435d-ac75-675b0bf645c4 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:22:43.269666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.277220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c4e26583-47a1-4bba-8a48-805829826cef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.147121 Oct 05 20:22:43.277814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 62/136] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:43 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:43.282708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:43.283311 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:43.288695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.289175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.289644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.290457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.290912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.291337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.358124 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2b8c28f9-c500-4302-982a-69d212ef3cd4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4/action" status: 200 len: 32 microversion: 2.1 time: 0.201809 Oct 05 20:22:43.358728 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 75/137] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:22:43 2022] POST /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4/action => generated 32 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 20:22:43.369723 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:43.370416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:43.376571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.377054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.377485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.378203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:43.378642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:43.379055 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:43.435842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.444190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.445658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.446762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ce74287e-5ef7-4bdc-a93f-42446a5d6d43 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.168036 Oct 05 20:22:43.447326 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 63/138] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:43 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:43.508613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:43.516779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7edf1f19-7db3-4aec-878c-93de637a10c2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.152419 Oct 05 20:22:43.517384 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 76/139] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:43 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:44.037100 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:44.037669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:44.043534 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.044019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.045031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.045750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.046207 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.046632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.170954 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:44.178463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c3cffa70-3e76-407d-acec-56ebc8cc1bfc tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.145251 Oct 05 20:22:44.179034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 64/140] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:44 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:44.300108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:44.300640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:44.306549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.307023 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.307448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.308124 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.308571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.308985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.437734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:44.445629 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9b346778-b3d4-4351-b0ad-e0fdc553828c tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.149370 Oct 05 20:22:44.446194 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 77/141] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:44 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:44.472077 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:44.472677 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:44.478480 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.478953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.479378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.480052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.480496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.480911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.540157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:44.540776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:44.546748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.547239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.547681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.548377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:44.548833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:44.549257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:44.694406 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:44.703245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-85cec2af-ae19-4ed1-aae9-09356d5de75e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.167042 Oct 05 20:22:44.704024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 78/142] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:44 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:44.781201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:44.789141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:44.790624 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:44.791681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-28b93612-e846-40f2-850d-0c4b7d755518 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.323495 Oct 05 20:22:44.792235 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 65/143] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:44 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:45.202214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:45.202830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:45.208698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.209190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.209651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.210341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.210787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.211204 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.346505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:45.354403 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e55caa0f-2e89-4843-a075-1e543fbe507c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.156636 Oct 05 20:22:45.354980 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 79/144] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:45 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:45.469368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:45.470262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:45.478218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.478838 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.479439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.480244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.480807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.481351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.614218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:45.626210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-382ff0e0-d3fb-4837-8460-2c7633397824 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.160854 Oct 05 20:22:45.637701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 66/145] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:45 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:45.726339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:45.728634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:45.735867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.736372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.736808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.737503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.737979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.738400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.817456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:45.818090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:45.833953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.834263 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.834698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:45.835420 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:45.835874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:45.836294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:46.060548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:46.066115 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:46.072698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:46.074737 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:46.077278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6311e5c5-9c4f-4e06-8fd2-2ae5b35f862a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.264305 Oct 05 20:22:46.089538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b08fe649-590f-4859-9f1e-c10f70455e45 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.355514 Oct 05 20:22:46.089538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 80/146] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:45 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:46.089538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-0b19d5b3-9087-4f6c-80ae-337d74cd384d req-f65002e6-d76a-4cd7-936f-2e04f62d6f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "name": "network-vif-plugged", "status": "completed", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:46.093548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 67/147] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:45 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:46.098044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0b19d5b3-9087-4f6c-80ae-337d74cd384d req-f65002e6-d76a-4cd7-936f-2e04f62d6f02 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:46.098718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0b19d5b3-9087-4f6c-80ae-337d74cd384d req-f65002e6-d76a-4cd7-936f-2e04f62d6f02 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:46.099336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0b19d5b3-9087-4f6c-80ae-337d74cd384d req-f65002e6-d76a-4cd7-936f-2e04f62d6f02 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:46.113116 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-0b19d5b3-9087-4f6c-80ae-337d74cd384d req-f65002e6-d76a-4cd7-936f-2e04f62d6f02 service nova] Creating event network-vif-plugged:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:22:46.119434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-0b19d5b3-9087-4f6c-80ae-337d74cd384d req-f65002e6-d76a-4cd7-936f-2e04f62d6f02 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035462 Oct 05 20:22:46.120116 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 81/148] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:46.377589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:46.378208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:46.387151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:46.390241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:46.391789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:46.393245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:46.394867 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:46.395589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:46.596281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:46.605464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d3d9ad6f-13ca-408d-8f01-3b4115b31f62 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.232346 Oct 05 20:22:46.606064 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 68/149] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:46 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:46.648714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:46.649620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:46.656571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:46.657237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:46.657719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:46.658419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:46.658877 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:46.659304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:46.805253 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:46.814620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2af41380-eb9b-4198-8ca2-b0d38ec5f000 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.170075 Oct 05 20:22:46.815314 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 82/150] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:46 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:47.108021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:47.108343 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:47.108633 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:47.109182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:47.115952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.116566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.117276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.118159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.118826 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.119398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.119598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.120054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.120556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.121254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.121732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.122768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.261474 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:47.262754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:47.269212 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cf89418b-0aa6-42f4-a92b-17f96c8bfd77 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.165689 Oct 05 20:22:47.269805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 69/151] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:47 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:47.270860 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:47.272294 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:47.273385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-016bbcad-86b1-4006-87f8-65a550b218f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.169811 Oct 05 20:22:47.273950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 83/152] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:47 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:47.629303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:47.629941 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:47.636093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.636578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.637014 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.637733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.638190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.638616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.761889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:47.769351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-52063f1a-51a2-436a-a2bd-fbc586479474 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.143875 Oct 05 20:22:47.769955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 70/153] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:47 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:47.838195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:47.838802 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:47.845256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.845766 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.846197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.846872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:47.847317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:47.847735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:47.978690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:47.986307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ce84eb5e-0aba-4ec3-b2c2-ffcd842fe148 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.151887 Oct 05 20:22:47.986872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 84/154] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:47 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:48.291744 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:48.292360 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:48.294229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=97 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:48.298316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:48.298928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:48.299596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:48.300087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:48.300525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:48.301222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:48.301709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:48.302136 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:48.304738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:48.305223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:48.305697 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:48.306383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:48.306837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:48.307264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:48.430632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:48.437866 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:48.438873 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1e8a8e07-a55f-42a8-926b-3e716ecf5deb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.151015 Oct 05 20:22:48.439451 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 71/155] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:48 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:48.446634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:48.448108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:48.449241 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a11de56f-bee5-43f2-bd9f-630dc7657254 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.154888 Oct 05 20:22:48.449828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 85/156] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:48 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:48.792145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:48.792654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:48.798467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:48.798936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:48.799364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:48.800035 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:48.800476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:48.800891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:48.930896 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:48.939098 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-db9d6a41-baa5-496e-b838-1f759b408ff4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.150849 Oct 05 20:22:48.939665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 72/157] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:48 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:49.008873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:49.009488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:49.016028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.016506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.016938 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.017664 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.018107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.018529 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.036486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:49.146428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:49.154343 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e343ac29-4cf3-4db7-9b67-987585fdddef tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1315 microversion: 2.1 time: 0.149283 Oct 05 20:22:49.155282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 86/158] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:49 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:49.462383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:49.462989 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:49.468755 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.469231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.469700 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.470384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.470829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.476565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:49.476565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:49.482088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.482576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.483013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.483696 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.484522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.484946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.600914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:49.610787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3f77acad-5e52-4e4f-b5ed-b1e880c7ee15 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.152130 Oct 05 20:22:49.611524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 73/159] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:49 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:49.624900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:49.633684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:49.635143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:49.636252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-84bb1e67-813c-4683-ba4e-004ea501b3b3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.165104 Oct 05 20:22:49.636817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 87/160] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:49 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:49.967220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:49.968748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:49.977061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.977567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.978000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:49.979019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:49.979465 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:49.979892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.112542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:50.120159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b656c6e0-815f-4212-8948-35d799e2eac3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.159412 Oct 05 20:22:50.120725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 74/161] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:49 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:50.176868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:50.177405 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:50.183242 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:50.183723 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:50.184160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.184842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:50.185291 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:50.185743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.322114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:50.331040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7774874f-45c1-4ea4-9140-ced361881ce1 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1501 microversion: 2.1 time: 0.158113 Oct 05 20:22:50.331787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 88/162] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:50 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:50.634891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:50.636322 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:50.643149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:50.643835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:50.644514 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.645208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:50.645869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:50.646293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.661394 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:50.662163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:50.671082 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:50.671764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:50.672554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.673458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:50.674073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:50.674778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:50.867711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:50.876929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f7a9f1f8-1899-4a7f-b722-e3875dc7c1cc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.245847 Oct 05 20:22:50.878666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 75/163] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:50 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:50.890608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:50.901070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:50.902581 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:50.903732 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d2e502a9-880d-4b85-b075-7e750a43baa9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.247335 Oct 05 20:22:50.904296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 89/164] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:50 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:51.142615 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:51.143223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:51.148916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:51.149396 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:51.149969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:51.150530 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:51.150977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:51.151397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:51.297854 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:51.307065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-abc1d34c-e09e-4817-832e-f9534563adba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.167837 Oct 05 20:22:51.307794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 76/165] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:51 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:51.900064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:51.900671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:51.906595 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:51.907325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:51.907757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:51.908431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:51.908875 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:51.909304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:51.930354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:51.930960 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:51.937352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:51.937868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:51.938301 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:51.938990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:51.939442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:51.939865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:52.039773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:52.048393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8f1ebe79-6766-4456-9a21-f6001fcc2592 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.152120 Oct 05 20:22:52.049245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 90/166] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:51 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:52.068286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:52.070527 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:52.077375 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:52.078839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:52.079920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3a659cd0-9749-4ac3-bebc-3fc6abfdc006 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.153445 Oct 05 20:22:52.080469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 77/167] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:51 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:52.331502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:52.332018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:52.337901 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:52.338378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:52.338805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:52.339479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:52.339925 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:52.340342 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:52.471894 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:52.479436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-cc25fe4f-7482-4dc1-b03f-47bd3483b618 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.151807 Oct 05 20:22:52.480004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 91/168] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:52 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:53.070762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:53.071304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:53.077082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:53.077671 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:53.078107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:53.078793 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:53.079245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:53.079667 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:53.104123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:53.104848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:53.111412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:53.111893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:53.112328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:53.113016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:53.113469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:53.113915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:53.209592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:53.217443 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-18c9eae8-bc71-4589-bb5c-1e16732d2b4e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.151018 Oct 05 20:22:53.218039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 78/169] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:53 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:53.244712 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:53.253345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:53.254810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:53.255910 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-05e18c06-e88c-4988-9a91-622a17d13a85 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.155676 Oct 05 20:22:53.256448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 92/170] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:53 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:53.502975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:53.503579 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:53.509342 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:53.509859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:53.510293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:53.510979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:53.511429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:53.511847 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:53.649311 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:53.657409 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-705eb85d-a9da-4246-8127-8cf5d2c7355e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1363 microversion: 2.1 time: 0.158320 Oct 05 20:22:53.658013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 79/171] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:53 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:54.241292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:54.241863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:54.243735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:22:54.249539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.250019 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.250449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.251131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.251575 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.252019 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.280358 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:54.281595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:54.287388 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.287877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.288429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.289056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.289595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.290023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.387300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:54.401989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5024ecd5-19b8-4f5c-b8cd-e3d698ac9544 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.164630 Oct 05 20:22:54.418352 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 93/172] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:54 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:54.441422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:54.441422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:54.442988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:54.444265 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f9a5730e-80ef-40d6-a543-88afcfa8b5e2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.167823 Oct 05 20:22:54.444710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 80/173] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:54 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:22:54.680989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:54.681725 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:54.688196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.688676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.689374 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.690219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.690830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.691398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.829367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:54.838218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b1b0cc7a-4bd9-4923-b9b2-3b589fbfb1ad tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1550 microversion: 2.1 time: 0.161043 Oct 05 20:22:54.838928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 94/174] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:54 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:54.862660 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:54.863664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:54.871507 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.872787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.873373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:54.874253 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:54.874850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:54.875418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.009310 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c620615-a62a-4ea8-898b-23bc77aeaef9"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:55.011190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-425c657a-5f82-4f1e-ae4c-b0a49429ed01 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152769 Oct 05 20:22:55.011768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:55.017868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 81/175] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:22:54 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:55.018466 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:55.018961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:55.019400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.020100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:55.020557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:55.020979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.425829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:55.426454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:55.432281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:55.432766 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:55.433214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.433952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:55.435027 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:55.435458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.815037 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:55.826066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1d462aa5-c033-4dd9-a417-eb1fe1e81c70 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.403984 Oct 05 20:22:55.828978 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 82/176] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:55 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:22:55.834146 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:55.835022 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:55.841588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:55.842303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:55.842941 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.843847 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:55.844683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:55.845372 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:55.926735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-cab791d8-58a2-45d9-8799-6b96ac411b5e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "POST /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.921163 Oct 05 20:22:55.930641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 95/177] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:22:55 2022] POST /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:22:56.337971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:56.347244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:56.350037 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:56.351165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-db45e55b-5544-4096-833b-7500f2695856 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1408 microversion: 2.20 time: 0.520932 Oct 05 20:22:56.352073 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 83/178] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:55 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1408 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:56.660094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-d7a7ad6b-8d50-4d94-9341-6571f2e2c22f req-e8f7e358-5356-4863-a336-0c26312c5eae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc97e634-82d8-4433-bee0-6d00f84075e7", "tag": "0b7637cb-b026-4f28-9263-f8fb7d10f2e2"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:56.683075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d7a7ad6b-8d50-4d94-9341-6571f2e2c22f req-e8f7e358-5356-4863-a336-0c26312c5eae service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:56.684029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d7a7ad6b-8d50-4d94-9341-6571f2e2c22f req-e8f7e358-5356-4863-a336-0c26312c5eae service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:56.684987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d7a7ad6b-8d50-4d94-9341-6571f2e2c22f req-e8f7e358-5356-4863-a336-0c26312c5eae service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:56.700678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-d7a7ad6b-8d50-4d94-9341-6571f2e2c22f req-e8f7e358-5356-4863-a336-0c26312c5eae service nova] Creating event network-changed:0b7637cb-b026-4f28-9263-f8fb7d10f2e2 for instance cc97e634-82d8-4433-bee0-6d00f84075e7 on hv-cinder-80152 Oct 05 20:22:56.707313 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-d7a7ad6b-8d50-4d94-9341-6571f2e2c22f req-e8f7e358-5356-4863-a336-0c26312c5eae service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053700 Oct 05 20:22:56.708190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 96/179] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:56.858945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:56.860202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:56.867274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:56.867805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:56.868469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:56.869391 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:56.870202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:56.870821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:57.134036 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:57.145757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-abb7022b-1c84-4627-832c-8b3d3a9fd72d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.293559 Oct 05 20:22:57.157582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 84/180] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:56 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:57.378780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:57.380167 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:57.395567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:57.396190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:57.396584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:57.397880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:57.402110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:57.402658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:57.806138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:57.822542 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:57.857947 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:57.864606 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-16ffedb1-3599-40c7-af46-13bfea0c82de tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1599 microversion: 2.20 time: 0.487672 Oct 05 20:22:57.869155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 97/181] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:22:57 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1599 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:22:57.893856 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:57.894924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:57.901697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:57.902430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:57.903676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:57.904595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:57.905216 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:57.906005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:58.045506 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-fb3b5816-9ee8-4bb1-b782-dd462ef5bcac tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.156243 Oct 05 20:22:58.046574 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 85/182] 10.222.0.23 () {60 vars in 1316 bytes} [Wed Oct 5 20:22:57 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-interface => generated 284 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:22:58.173821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:58.174892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:58.186686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:58.189198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:58.189972 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:58.191162 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:58.192820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:58.193956 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:58.529045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:58.539951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-80cde91a-a99d-4c1c-beb1-43f336b5e309 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.370723 Oct 05 20:22:58.540647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 98/183] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:58 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:22:59.568733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:22:59.569942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:22:59.580080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:59.583417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:59.587525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:59.588444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:59.589791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:59.591441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:59.877922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-25d91dec-be42-4160-9b8b-236ccb1c005e req-056608e1-d5a0-4a1d-a535-e6bd024de3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:22:59.893088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-25d91dec-be42-4160-9b8b-236ccb1c005e req-056608e1-d5a0-4a1d-a535-e6bd024de3cd service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:22:59.894511 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-25d91dec-be42-4160-9b8b-236ccb1c005e req-056608e1-d5a0-4a1d-a535-e6bd024de3cd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:22:59.895153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-25d91dec-be42-4160-9b8b-236ccb1c005e req-056608e1-d5a0-4a1d-a535-e6bd024de3cd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:22:59.911040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-25d91dec-be42-4160-9b8b-236ccb1c005e req-056608e1-d5a0-4a1d-a535-e6bd024de3cd service nova] Creating event network-changed:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:22:59.916648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-25d91dec-be42-4160-9b8b-236ccb1c005e req-056608e1-d5a0-4a1d-a535-e6bd024de3cd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051232 Oct 05 20:22:59.917848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 99/184] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:22:59.980784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:22:59.990124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-94b72b32-a7cf-4134-91ec-ca460bff151e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.425666 Oct 05 20:23:00.003523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 86/185] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:22:59 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:01.023154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:01.025141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:01.034548 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:01.035108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:01.035756 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:01.037030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:01.037951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:01.038584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:01.208890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:01.218021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2d641adf-8f00-452e-9e2a-f010e7789351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.200327 Oct 05 20:23:01.218612 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 100/186] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:01 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:02.240792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:02.241487 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:02.247911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:02.248525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:02.249030 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:02.249980 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:02.250513 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:02.251475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:02.409044 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:02.436254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2ed61bae-6527-411b-a8a5-9781a5460647 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.199830 Oct 05 20:23:02.437311 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 87/187] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:02 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:03.460345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:03.461775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:03.469419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:03.470295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:03.470951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:03.471838 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:03.472475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:03.472899 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:03.631837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:03.643609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c7f7d523-cc6c-4802-8861-c40061c2f131 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.187171 Oct 05 20:23:03.644186 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 101/188] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:03 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:04.667963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:04.668564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:04.675828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:04.676456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:04.677023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:04.677817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:04.678335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:04.679066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:04.831926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:04.840469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-aa48afa7-46f7-4312-88da-a659be5d48dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.176202 Oct 05 20:23:04.841293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 88/189] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:04 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:05.021442 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1523306280", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "networks": [{"uuid": "239503aa-bfd9-4c9f-872c-79484a7b0a69"}]}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:05.045757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-768692729", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "networks": [{"uuid": "8161c64b-ad1b-4220-99b9-84126ab53e0a"}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:05.097701 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] validate_networks() for [('239503aa-bfd9-4c9f-872c-79484a7b0a69', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:23:05.111762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] validate_networks() for [('8161c64b-ad1b-4220-99b9-84126ab53e0a', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:23:05.518806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:23:05.519220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:23:05.519683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:23:05.520082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:23:05.520480 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:23:05.529270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:05.529805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:05.530234 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:05.530946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:05.531392 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:05.531806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:05.548204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Getting quotas for project 1c2141e33c264250aa7642f46a9b4048. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:23:05.552846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Getting quotas for user 776c647ef6d34d989ac12d4e91cc62ab and project 1c2141e33c264250aa7642f46a9b4048. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:23:05.564057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:23:05.566359 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:23:05.584277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:23:05.584697 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:23:05.585317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:23:05.585748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:23:05.586159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:23:05.595589 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:05.596073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:05.596762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:05.597799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:05.598488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:05.598916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:05.614041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8c60c8b3-eacc-4557-ac64-56e312727d8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574026 Oct 05 20:23:05.614684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 89/190] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 20:23:05.617048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Getting quotas for project 25c983389ecf447c9ca4bd6ca01b5a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:23:05.621990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Getting quotas for user 1b8c41cfa6854a528f43e82e0fb26220 and project 25c983389ecf447c9ca4bd6ca01b5a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:23:05.627221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7296af81-e7a6-42d6-bb25-345ae2072179 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:05.628088 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7296af81-e7a6-42d6-bb25-345ae2072179 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:05.639489 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:23:05.642051 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:23:05.691026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7296af81-e7a6-42d6-bb25-345ae2072179 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:05.698810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7296af81-e7a6-42d6-bb25-345ae2072179 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1218 microversion: 2.1 time: 0.076496 Oct 05 20:23:05.699198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-328f41c0-7bf3-46b2-8991-fb68938164e3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682046 Oct 05 20:23:05.700175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 90/191] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:05 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:05.706478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 102/192] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:23:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:23:05.719505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f3b711c9-fa9a-4879-a50e-ab4de5a01537 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:05.720144 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f3b711c9-fa9a-4879-a50e-ab4de5a01537 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:05.822075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f3b711c9-fa9a-4879-a50e-ab4de5a01537 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:05.831148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f3b711c9-fa9a-4879-a50e-ab4de5a01537 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1214 microversion: 2.1 time: 0.115089 Oct 05 20:23:05.832551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 91/193] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:05 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:05.865906 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:05.867123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:05.881228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:05.884219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:05.886801 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:05.889819 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:05.890476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:05.891056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:06.045187 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:06.049573 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:06.055380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ede04245-c242-4664-a6b7-360f97d68fa0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.194988 Oct 05 20:23:06.056331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 103/194] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:05 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:06.723423 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:06.723963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:06.729949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:06.730429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:06.731128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:06.732191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:06.732787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:06.733214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:06.816521 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:06.826338 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c0996622-c9c1-4998-beaa-6236c5518619 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1270 microversion: 2.1 time: 0.106019 Oct 05 20:23:06.827483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 92/195] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:06 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:06.854823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:06.855364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:06.862336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:06.862832 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:06.863274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:06.864066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:06.864683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:06.865113 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:06.925943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:06.933671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-89ccbf7f-1128-4f61-8fd3-714f567cc3ce tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1210 microversion: 2.1 time: 0.083446 Oct 05 20:23:06.934234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 104/196] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:06 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:07.032777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:07.033268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:07.039546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.040025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.040456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.041131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.041605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.042025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.066365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:23:07.080731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:07.081343 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:07.087605 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.088092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.088531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.089245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.089733 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.090157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.157547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b06c1137-0ee5-4dc2-a0da-e3d7158113d7 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 204 len: 0 microversion: 2.1 time: 0.128229 Oct 05 20:23:07.158197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 93/197] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:23:07 2022] DELETE /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:23:07.167355 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:07.168203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:07.174196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.174676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.175108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.175811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.176243 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.176657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.230430 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:07.238634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0fb197ab-ea22-4d8d-be16-83345e24eea8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.161760 Oct 05 20:23:07.239412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 105/198] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:07 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:07.313032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:07.322155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6d782f6b-0dbe-480f-8261-6f63bc00e969 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1553 microversion: 2.1 time: 0.159299 Oct 05 20:23:07.322810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 94/199] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:07 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:07.859587 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:07.860319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:07.872806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.873696 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.874376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.875281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.876007 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.876925 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.951775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:07.958218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:07.958843 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:07.963749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-149763f6-f0dc-46f9-9ea4-fc118b5141e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1278 microversion: 2.1 time: 0.108424 Oct 05 20:23:07.964645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 106/200] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:07 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:07.982553 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.983105 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.983585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:07.984469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:07.985502 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:07.985958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:08.067442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:08.076479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6f2fbc01-896f-4ff3-bd55-45e94ab6dad1 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1266 microversion: 2.1 time: 0.123626 Oct 05 20:23:08.089845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 95/201] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:07 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:08.263750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:08.264361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:08.271499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:08.271871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:08.272338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:08.273001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:08.273588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:08.273924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:08.345463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:08.346255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:08.352580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:08.353709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:08.354391 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:08.355996 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:08.356429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:08.357015 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:08.363115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:08.422795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:08.431157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1b3d7b54-9499-41f5-99f5-d418990815d0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.171793 Oct 05 20:23:08.431986 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 107/202] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:08 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:08.499209 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:08.507339 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-98707755-674f-4d87-90fe-4b9169c1e442 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1553 microversion: 2.1 time: 0.166519 Oct 05 20:23:08.507907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 96/203] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:08 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:08.987358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:08.987982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:08.993746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:08.994229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:08.994657 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:08.995339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:08.995784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:08.996199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.064464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:09.068496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dd42b492-cbf0-4bce-953f-bcd2faace8d7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1278 microversion: 2.1 time: 0.085539 Oct 05 20:23:09.069228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 108/204] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:08 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:09.098795 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:09.099487 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:09.105589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:09.106152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:09.106776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.108070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:09.108537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:09.108970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.170894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:09.178927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f6e50f33-8ec7-4ddf-8c52-73fe697e70c6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1266 microversion: 2.1 time: 0.083997 Oct 05 20:23:09.179499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 97/205] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:09 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:09.456138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:09.457617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:09.473200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:09.473734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:09.474176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.474886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:09.475358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:09.475790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.531111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:09.531756 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:09.538713 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:09.540166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:09.540786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.541748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:09.542682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:09.543264 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:09.680525 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:09.694141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b6c150ec-4461-47d3-bb2a-7c56444c0d10 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.241946 Oct 05 20:23:09.695057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 109/206] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:09 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:09.757162 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:09.766193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-505fe1a5-243f-4c70-ab5c-aebb1ec8e2be tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1553 microversion: 2.1 time: 0.239038 Oct 05 20:23:09.766912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 98/207] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:09 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:10.091825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:10.092447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:10.100830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.102433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.102881 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.103904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.104591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.105247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.202913 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:10.203521 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:10.209962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.210447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.210876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.213277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.217879 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.218355 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.270727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:10.285764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e4c4604d-7b44-40e1-8670-fab25b5bb89a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1276 microversion: 2.1 time: 0.197003 Oct 05 20:23:10.288686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 110/208] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:10 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:10.305223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:10.316276 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-053b6617-5c38-42fa-9456-c217bfe4da04 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1266 microversion: 2.1 time: 0.117400 Oct 05 20:23:10.316678 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 99/209] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:10 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:10.721702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:10.723008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:10.734647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.735497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.736284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.738035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.739292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.739991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.790967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:10.792563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:10.808931 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.810441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.812269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:10.813446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:10.814313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:10.815441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:11.136527 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:11.149953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a530583e-fd38-4a59-93eb-4fb2793c6b8e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1553 microversion: 2.1 time: 0.363353 Oct 05 20:23:11.162535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 100/210] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:10 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1553 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:11.187630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:11.196145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-22d75beb-a9b7-4677-b7f1-f624ac0b047a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.479182 Oct 05 20:23:11.197202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 111/211] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:10 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:11.315769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:11.316478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:11.326987 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:11.327657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:11.328241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:11.329137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:11.329894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:11.331130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:11.344564 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:11.350090 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:11.371312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:11.372111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:11.375556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:11.376845 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:11.378145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:11.379013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:11.523169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:11.543130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dec02605-af12-49b7-aee0-09fae6ee4ecd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1272 microversion: 2.1 time: 0.207015 Oct 05 20:23:11.547196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 112/212] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:11 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:11.618941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-2345ee1b-f01d-41ed-8f71-5ec5c046fd8f req-b1a60da1-5105-4222-93ee-0942fbb5d066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a10e8a38-b20d-4dde-8f5f-566740f633fc", "name": "network-vif-deleted", "tag": "afe64fa3-44ab-44b3-a977-349ea8ab76cc"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:11.630576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-2345ee1b-f01d-41ed-8f71-5ec5c046fd8f req-b1a60da1-5105-4222-93ee-0942fbb5d066 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:11.631215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-2345ee1b-f01d-41ed-8f71-5ec5c046fd8f req-b1a60da1-5105-4222-93ee-0942fbb5d066 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:11.631937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-2345ee1b-f01d-41ed-8f71-5ec5c046fd8f req-b1a60da1-5105-4222-93ee-0942fbb5d066 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:11.645400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-2345ee1b-f01d-41ed-8f71-5ec5c046fd8f req-b1a60da1-5105-4222-93ee-0942fbb5d066 service nova] Creating event network-vif-deleted:afe64fa3-44ab-44b3-a977-349ea8ab76cc for instance a10e8a38-b20d-4dde-8f5f-566740f633fc on hv-cinder-80152 Oct 05 20:23:11.650942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-2345ee1b-f01d-41ed-8f71-5ec5c046fd8f req-b1a60da1-5105-4222-93ee-0942fbb5d066 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035994 Oct 05 20:23:11.652240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 113/213] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:23:11.661828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:11.676802 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cc1ae3fe-8dde-4e18-b822-2b72cba9259b tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.365442 Oct 05 20:23:11.678211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 101/214] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:11 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:12.178330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:12.179656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:12.196381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.198364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.200109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.202367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.205176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.205774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.225151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:12.226672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:12.239536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.240331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.240918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.241948 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.242633 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.243347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.298862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.299467 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.299922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.300380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lazy-loading 'fault' on Instance uuid a10e8a38-b20d-4dde-8f5f-566740f633fc {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:23:12.407472 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:12.437682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f808f04f-a7c9-43c2-884b-f6f52cad369b tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1351 microversion: 2.1 time: 0.266722 Oct 05 20:23:12.444649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 114/215] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:12 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1351 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:12.568127 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:12.575857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:12.576490 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:12.585740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.586233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.586662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.590380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.590848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.591457 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.599144 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7e0e398b-fccb-4c41-ac6f-1eaaa5718acf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.378695 Oct 05 20:23:12.604521 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 102/216] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:12 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:12.700618 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:12.700867 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:12.710095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.710604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.713475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.714522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:12.715141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:12.715576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:12.898796 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:12.907218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ab2f5193-4596-4379-b1bd-3e7d79aa20b5 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.335274 Oct 05 20:23:12.907806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 115/217] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:12 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:12.984944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:12.995002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4b07527a-a893-4141-bb3b-da34b9040e67 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.298425 Oct 05 20:23:12.996070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 103/218] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:12 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:13.092470 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-bb267568-f705-46ce-ba0a-11bc15081599 req-7f6270fc-93ea-41fa-a2c3-a5a059ae09ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8", "tag": "26a29d99-0bbb-4f57-ac65-df7736b3776c"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:13.102639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-bb267568-f705-46ce-ba0a-11bc15081599 req-7f6270fc-93ea-41fa-a2c3-a5a059ae09ba service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.103116 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-bb267568-f705-46ce-ba0a-11bc15081599 req-7f6270fc-93ea-41fa-a2c3-a5a059ae09ba service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.103712 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-bb267568-f705-46ce-ba0a-11bc15081599 req-7f6270fc-93ea-41fa-a2c3-a5a059ae09ba service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.116006 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-bb267568-f705-46ce-ba0a-11bc15081599 req-7f6270fc-93ea-41fa-a2c3-a5a059ae09ba service nova] Creating event network-changed:26a29d99-0bbb-4f57-ac65-df7736b3776c for instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 on hv-cinder-80152 Oct 05 20:23:13.121071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-bb267568-f705-46ce-ba0a-11bc15081599 req-7f6270fc-93ea-41fa-a2c3-a5a059ae09ba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033384 Oct 05 20:23:13.121709 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 116/219] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:13.471015 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:13.471562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:13.477913 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.478398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.478826 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.480047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.480047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.480408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.510269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.510745 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.511389 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.511845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lazy-loading 'fault' on Instance uuid a10e8a38-b20d-4dde-8f5f-566740f633fc {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:23:13.556740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:13.565847 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-57a92552-8e19-4e6c-802a-809435dd9465 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1351 microversion: 2.1 time: 0.099494 Oct 05 20:23:13.566417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 104/220] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:13 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:13.631941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:13.632720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:13.639574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.640067 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.640501 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.641430 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.642045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.642401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.678823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-b844d87d-a127-4418-9044-b0ab2302f03d req-d121e563-7404-4ee0-8cef-b74e478fb5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52c5126d-2b2b-4cc9-a187-511c93edaa78", "tag": "ab41397f-21da-4863-a97b-9e600a47ad52"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:13.690567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-b844d87d-a127-4418-9044-b0ab2302f03d req-d121e563-7404-4ee0-8cef-b74e478fb5da service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.691534 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-b844d87d-a127-4418-9044-b0ab2302f03d req-d121e563-7404-4ee0-8cef-b74e478fb5da service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.695207 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-b844d87d-a127-4418-9044-b0ab2302f03d req-d121e563-7404-4ee0-8cef-b74e478fb5da service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.713754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-b844d87d-a127-4418-9044-b0ab2302f03d req-d121e563-7404-4ee0-8cef-b74e478fb5da service nova] Creating event network-changed:ab41397f-21da-4863-a97b-9e600a47ad52 for instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 on hv-cinder-80152 Oct 05 20:23:13.719720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-b844d87d-a127-4418-9044-b0ab2302f03d req-d121e563-7404-4ee0-8cef-b74e478fb5da service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044859 Oct 05 20:23:13.720333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 105/221] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:23:13.807969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:13.816223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7cff0fe3-fe2a-486b-940e-331d62ca949a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.188827 Oct 05 20:23:13.816786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 117/222] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:13 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:13.931331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:13.932024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:13.938158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.938644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.939078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:13.939776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:13.940233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:13.940655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.018263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:14.018873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:14.024760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.025245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.025715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.026405 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.026859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.027281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.067754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:14.075926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-12d8dcd1-2cd4-47ec-9c56-419b6aea2ca2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.148284 Oct 05 20:23:14.076507 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 106/223] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:13 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:14.162859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:14.170557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7f68f8f8-3eb9-43f4-a9aa-24d9b597ecce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.156147 Oct 05 20:23:14.171122 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 118/224] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:14 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:14.588046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:14.588661 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:14.594609 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.595095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.595563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.596258 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.596714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.597140 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.623346 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:14.629499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.630050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.630483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.630947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lazy-loading 'fault' on Instance uuid a10e8a38-b20d-4dde-8f5f-566740f633fc {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:23:14.671369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:14.679270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-da062497-dc34-46c9-9490-b4116bc1d273 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1351 microversion: 2.1 time: 0.095076 Oct 05 20:23:14.679858 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 107/225] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:14 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:14.839632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:14.840249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:14.846635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.847138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.847561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.848251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:14.848708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:14.849137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:14.977415 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:14.985636 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-30d1a8c3-1860-4d72-b8ff-04a03bc9ff4d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.149804 Oct 05 20:23:14.986373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 119/226] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:14 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:15.098701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:15.099374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:15.105214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.105732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.106166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.107350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.107805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.108225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.193883 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:15.194576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:15.200623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.201182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.201743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.202513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.203033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.203522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.237232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:15.245229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b4783d8d-9d98-4ac4-8b26-dd01907b196a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.150253 Oct 05 20:23:15.245833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 108/227] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:15 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:15.332353 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:15.339878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6aba4ba4-39ce-4e4d-95c3-c2e576cc4e4a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.150274 Oct 05 20:23:15.340430 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 120/228] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:15 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:15.703269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:15.703883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:15.706049 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:15.712032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.712520 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.712955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.713689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.714145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.714701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.753004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:15.753467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:15.754133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:15.754741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lazy-loading 'fault' on Instance uuid a10e8a38-b20d-4dde-8f5f-566740f633fc {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:23:15.826575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=10 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:15.851429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a553cd4c2e154ee1979812ae575e6fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38145c704ac548abb6747e073892ff72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:15.859111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-49b260d0-f17c-4df2-8817-9c357b114d26 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 200 len: 1305 microversion: 2.1 time: 0.160173 Oct 05 20:23:15.860121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 109/229] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:15 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:16.008573 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:16.010052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:16.012334 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:16.013881 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:16.021033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.021651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.022298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.023157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.023765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.024355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.044622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:16.168438 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:16.176895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-535bd8b5-e7b9-4147-aa17-3d3b558a365c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.172175 Oct 05 20:23:16.177468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 121/230] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:16 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:16.267911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:16.268529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:16.274868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.275365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.275800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.276501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.276953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.277377 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.363344 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:16.364065 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:16.370517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.371177 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.371721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.373158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.373761 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.374293 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.579547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:16.588210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-22f78e9b-410c-4b8c-a167-07212aa45d6e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.228702 Oct 05 20:23:16.589076 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 122/231] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:16 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:16.695416 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:16.702993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a0f8231f-dd6b-4cf2-9fd5-5beb5112bc76 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.439683 Oct 05 20:23:16.703569 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 110/232] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:16 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:16.882989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:16.883600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:16.890239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.890722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.891156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.891840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:16.892556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:16.893093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:16.908482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] HTTP exception thrown: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Request method failure captured: Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc HTTP/1.1 Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedpGklqBd4I5qGfOkpVKRknFZCgX-KDTCTDzzIqanCKL04p9WYebdjRXHanwMuWtczqusJIqaARrUpwvlPAOeuz2Gu-jIyLGU4slVymga83gn8X4fP_9UlEr4-9ekPEq7t-D9Ajy9MbZEfBqlu7auGltL66ZwswaIxKuXirhU0XSQQ Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:23:16.922615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38145c704ac548abb6747e073892ff72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38145c704ac548abb6747e073892ff72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: a553cd4c2e154ee1979812ae575e6fb2 Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:16.924070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'a10e8a38-b20d-4dde-8f5f-566740f633fc'} Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:23:16.924929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:16.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:23:16.927325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Returning 404 to user: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:23:16.927325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-25128a47-600e-48a2-85f3-19010e19dc71 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 404 len: 111 microversion: 2.1 time: 0.044979 Oct 05 20:23:16.927325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 123/233] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:16 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:23:17.051382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:17.053546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:17.060004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.060480 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.060906 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.061675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.062160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.062777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.078803 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] HTTP exception thrown: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Request method failure captured: Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc/os-volume_attachments HTTP/1.1 Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedpGklqBd4I5qGfOkpVKRknFZCgX-KDTCTDzzIqanCKL04p9WYebdjRXHanwMuWtczqusJIqaARrUpwvlPAOeuz2Gu-jIyLGU4slVymga83gn8X4fP_9UlEr4-9ekPEq7t-D9Ajy9MbZEfBqlu7auGltL66ZwswaIxKuXirhU0XSQQ Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:23:17.090454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38145c704ac548abb6747e073892ff72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38145c704ac548abb6747e073892ff72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: a553cd4c2e154ee1979812ae575e6fb2 Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:17.092620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'server_id': 'a10e8a38-b20d-4dde-8f5f-566740f633fc'} Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:23:17.093430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:17.094648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:17.095765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Returning 404 to user: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:23:17.095765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-20129b4d-13d9-4648-b516-e7dff4264723 tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045827 Oct 05 20:23:17.095765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 111/234] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:23:17 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:23:17.207245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:17.207987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:17.217667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.218228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.218746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.219639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.220233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.220609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.514720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:17.522296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-80cb534f-0f14-41df-bbd6-637a8d16a78a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.319828 Oct 05 20:23:17.522848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 124/235] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:17 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:17.611102 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:17.611708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:17.617600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.618081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.618511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.619193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.619645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.620063 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.726307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:17.727002 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:17.733198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.733784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.734218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.734903 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:17.735351 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:17.735765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:17.748326 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:17.755978 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d4b1fa43-674a-432b-b6a7-1bbe90492d20 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.148708 Oct 05 20:23:17.756569 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 112/236] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:17 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:17.862289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:17.870013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-822ebb01-e33f-4d03-85d1-ffc30e065806 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.147897 Oct 05 20:23:17.870583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 125/237] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:17 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:18.545191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:18.545892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:18.551735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:18.552208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:18.552632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:18.553315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:18.553786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:18.554206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:18.556681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:18.684634 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:18.693222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a0a10ad3-95b3-40de-9ff1-7a8394a6a33d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.152351 Oct 05 20:23:18.693891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 113/238] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:18 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:18.779336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:18.779954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:18.786517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:18.787006 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:18.787441 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:18.788137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:18.788710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:18.789008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:18.892477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:18.893112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:18.900320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:18.900984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:18.901625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:18.902561 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:18.903159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:18.905165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:18.929009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:18.937209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b6cf6725-4974-4d62-a2fa-828036c6fc97 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.161681 Oct 05 20:23:18.937879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 126/239] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:18 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:19.040801 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:19.049010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c21dcee3-b2be-4847-9298-65e7806725db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.160509 Oct 05 20:23:19.049595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 114/240] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:18 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:19.716601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:19.717237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:19.723283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:19.723764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:19.724196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:19.724880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:19.725332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:19.725778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:19.852968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:19.861240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2c0e2f9c-e5a6-4661-8ee2-dd5a46faed41 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.148978 Oct 05 20:23:19.861829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 127/241] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:19 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:19.960319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:19.960933 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:19.967618 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:19.968043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:19.968483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:19.969174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:19.969662 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:19.970089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:20.071376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:20.071987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:20.078370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:20.078861 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:20.079298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:20.079996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:20.080464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:20.080893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:20.095069 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:20.103320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-63439555-b517-45f9-9a01-91169c9e153e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.147236 Oct 05 20:23:20.103898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 115/242] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:19 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:20.212474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:20.221070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0a5c0986-1cb2-4323-993a-c0e6e8cad4a2 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.153444 Oct 05 20:23:20.221599 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 128/243] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:20 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:20.884011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:20.884612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:20.890719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:20.891198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:20.891631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:20.892314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:20.892757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:20.893172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:21.019199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:21.026914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6cd06083-c96f-41fb-b8df-4906e35a4dbf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.146770 Oct 05 20:23:21.027475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 116/244] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:20 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:21.126278 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:21.126890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:21.133326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:21.133780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:21.134216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:21.134902 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:21.135354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:21.135779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:21.244280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:21.244886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:21.250651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:21.251134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:21.251566 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:21.252252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:21.252723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:21.253143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:21.265559 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:21.273197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-92c4b280-3251-4e5f-840a-f5bdc3810118 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.151353 Oct 05 20:23:21.273783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 129/245] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:21 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:21.381782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:21.389473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9d38ef07-ef11-42db-97a1-8bfba2ed723a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.149149 Oct 05 20:23:21.390003 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 117/246] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:21 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:22.049852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:22.050458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:22.056356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:22.056835 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:22.057264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:22.057969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:22.058416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:22.058840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:22.184517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:22.192572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2d7903eb-22b5-45b3-b3c1-4cf60ebb1dee tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.146647 Oct 05 20:23:22.193121 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 130/247] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:22 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:22.296617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:22.297290 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:22.303142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:22.303620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:22.304055 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:22.304741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:22.305192 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:22.305645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:22.412237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:22.413033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:22.418951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:22.419446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:22.421749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:22.421749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:22.421749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:22.421749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:22.433684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:22.441249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cd4abcc1-15f7-406d-9386-e9f23717704e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.149081 Oct 05 20:23:22.442091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 118/248] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:22 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:22.560381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:22.568365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a7e6af48-52c1-42d0-909d-97a9d3122559 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.160115 Oct 05 20:23:22.568928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 131/249] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:22 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:23.215404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:23.216012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:23.222049 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:23.222562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:23.222991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:23.223732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:23.224175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:23.224592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:23.354360 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:23.362347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ea8d9ea6-7a2e-4c14-8b24-23ae76d97b34 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.150822 Oct 05 20:23:23.362918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 119/250] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:23 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:23.464179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:23.464863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:23.471811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:23.472243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:23.472689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:23.473410 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:23.473897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:23.474328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:23.592734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:23.594419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:23.603509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:23.605098 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:23.605621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:23.606478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:23.607613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:23.608191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:23.617029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:23.626591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-08f52ed2-ac15-4c30-8bc1-4890eb41f40c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.166165 Oct 05 20:23:23.627449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 132/251] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:23 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:23.739897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:23.747499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-089e970c-531b-4b47-9e64-f6605c2dbf3e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.159763 Oct 05 20:23:23.748065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 120/252] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:23 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:24.386246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:24.386853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:24.388717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:24.393912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:24.394398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:24.394843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:24.395533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:24.395987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:24.396408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:24.521589 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:24.529673 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9aac9333-f71e-4731-8213-f60cd9011d33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.147254 Oct 05 20:23:24.530237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 133/253] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:24 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:24.651286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:24.651917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:24.663763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:24.664245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:24.664675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:24.665366 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:24.665856 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:24.666275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:24.769690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:24.770306 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:24.776363 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:24.776846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:24.777285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:24.778010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:24.779050 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:24.779477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:24.799926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:24.807500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7fc6d99a-67bd-4c0f-95bf-a0a9f9625d54 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.160326 Oct 05 20:23:24.808064 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 121/254] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:24 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:24.910999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:24.918594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1cac8d86-c2c7-41e9-ade0-a15492e76913 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.152858 Oct 05 20:23:24.919159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 134/255] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:24 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:25.553178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:25.553844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:25.560269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:25.561116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:25.561766 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:25.562456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:25.562998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:25.563428 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:25.697935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:25.706067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6bbd2cdf-205a-40a9-8078-32a2c5b8f995 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.156763 Oct 05 20:23:25.706631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 122/256] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:25 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:25.830996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:25.831550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:25.837627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:25.838118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:25.838557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:25.839253 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:25.839710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:25.840138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:25.940523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:25.941129 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:25.947334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:25.947817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:25.948254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:25.948947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:25.949403 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:25.949881 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:25.966071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:25.974250 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e14d541d-bdeb-4cf6-b91d-a1abd51d5a7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.147165 Oct 05 20:23:25.974813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 135/257] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:25 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:26.076014 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:26.083623 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-208e13b5-e07f-4760-abc4-adecf8468a29 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.146841 Oct 05 20:23:26.084125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 123/258] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:25 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:26.729392 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:26.730248 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:26.738223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:26.739053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:26.739458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:26.740166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:26.740753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:26.741270 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:26.925577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-44f3bdc9-ddac-43e9-9a9b-9b6f1c84ec0e req-2dcddd88-5ea5-4171-a290-e7f7f8a1ad48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8", "name": "network-vif-plugged", "status": "completed", "tag": "26a29d99-0bbb-4f57-ac65-df7736b3776c"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:26.939718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-44f3bdc9-ddac-43e9-9a9b-9b6f1c84ec0e req-2dcddd88-5ea5-4171-a290-e7f7f8a1ad48 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:26.940205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-44f3bdc9-ddac-43e9-9a9b-9b6f1c84ec0e req-2dcddd88-5ea5-4171-a290-e7f7f8a1ad48 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:26.940638 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-44f3bdc9-ddac-43e9-9a9b-9b6f1c84ec0e req-2dcddd88-5ea5-4171-a290-e7f7f8a1ad48 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:26.953146 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-44f3bdc9-ddac-43e9-9a9b-9b6f1c84ec0e req-2dcddd88-5ea5-4171-a290-e7f7f8a1ad48 service nova] Creating event network-vif-plugged:26a29d99-0bbb-4f57-ac65-df7736b3776c for instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 on hv-cinder-80152 Oct 05 20:23:26.954029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:26.959202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-44f3bdc9-ddac-43e9-9a9b-9b6f1c84ec0e req-2dcddd88-5ea5-4171-a290-e7f7f8a1ad48 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039007 Oct 05 20:23:26.960308 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 124/259] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:26.963042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e2121507-4e9a-4b1f-aa5e-d6a000235cdd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.237789 Oct 05 20:23:26.963613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 136/260] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:26 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:26.997918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:26.998778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:27.005855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.006347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:27.006936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:27.007742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.008198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:27.008624 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:27.105607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:27.106341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:27.112196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.112685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:27.113123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:27.113850 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.114493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:27.114920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:27.143048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:27.154352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a5ce1825-748b-49c3-9824-4b307bdd32b5 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.160351 Oct 05 20:23:27.155204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 125/261] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:26 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:27.256611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:27.264390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1a05587c-b3cb-4baf-b19e-db92aebe6dbb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.162843 Oct 05 20:23:27.264961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 137/262] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:27 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:27.951090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:27.952095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:27.959736 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.960232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:27.960676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:27.961841 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.962288 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:27.962705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:27.978284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] HTTP exception thrown: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Request method failure captured: Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: DELETE /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc HTTP/1.1 Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedpGklqBd4I5qGfOkpVKRknFZCgX-KDTCTDzzIqanCKL04p9WYebdjRXHanwMuWtczqusJIqaARrUpwvlPAOeuz2Gu-jIyLGU4slVymga83gn8X4fP_9UlEr4-9ekPEq7t-D9Ajy9MbZEfBqlu7auGltL66ZwswaIxKuXirhU0XSQQ Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:23:27.980524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38145c704ac548abb6747e073892ff72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38145c704ac548abb6747e073892ff72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: a553cd4c2e154ee1979812ae575e6fb2 Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:27.982019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'a10e8a38-b20d-4dde-8f5f-566740f633fc'} Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:23:27.982754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:27.984085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:27.985365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Returning 404 to user: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:23:27.985365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7190231b-0b22-4402-bfd3-1b7100fb911a tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 404 len: 111 microversion: 2.1 time: 0.037211 Oct 05 20:23:27.985365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 126/263] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:23:27 2022] DELETE /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:23:27.991714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:27.992392 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] [instance: a10e8a38-b20d-4dde-8f5f-566740f633fc] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:27.995115 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:27.996467 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:27.999251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:27.999762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.000390 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.001094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.001638 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.001975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.005998 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.007975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.008596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.009612 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.010231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.010827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.017758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] HTTP exception thrown: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Request method failure captured: Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc HTTP/1.1 Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedpGklqBd4I5qGfOkpVKRknFZCgX-KDTCTDzzIqanCKL04p9WYebdjRXHanwMuWtczqusJIqaARrUpwvlPAOeuz2Gu-jIyLGU4slVymga83gn8X4fP_9UlEr4-9ekPEq7t-D9Ajy9MbZEfBqlu7auGltL66ZwswaIxKuXirhU0XSQQ Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:23:28.019259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_38145c704ac548abb6747e073892ff72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/38145c704ac548abb6747e073892ff72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/38145c704ac548abb6747e073892ff72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 38145c704ac548abb6747e073892ff72 Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-DeleteServersTestJSON-1322436674 Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: a553cd4c2e154ee1979812ae575e6fb2 Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-DeleteServersTestJSON-1322436674-project Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:28.020657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'a10e8a38-b20d-4dde-8f5f-566740f633fc'} Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:23:28.024883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. Oct 05 20:23:28.026197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:28.027768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] Returning 404 to user: Instance a10e8a38-b20d-4dde-8f5f-566740f633fc could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:23:28.027768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2724d86a-41bf-41ff-aefd-a4de5bccb96e tempest-DeleteServersTestJSON-1322436674 tempest-DeleteServersTestJSON-1322436674-project] 10.222.0.23 "GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc" status: 404 len: 111 microversion: 2.1 time: 0.032584 Oct 05 20:23:28.027768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 127/264] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:27 2022] GET /compute/v2.1/servers/a10e8a38-b20d-4dde-8f5f-566740f633fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:23:28.178446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:28.179057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:28.185705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.186195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.186627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.187328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.187777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.188199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.322084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:28.329893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-654b0b7a-9fec-4f6d-9e9c-aefa2f49ffc8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.155256 Oct 05 20:23:28.330479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 128/265] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:28 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:28.340222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:28.340876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:28.346634 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.347116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.347581 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.348264 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:28.348715 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:28.349133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:28.452457 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:28.458316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:28.460965 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f0ef5fa0-7343-4262-9867-ec60aa12205d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.472464 Oct 05 20:23:28.470560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 138/266] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:27 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:28.480312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:28.488584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-84216cd1-3ad1-47c2-8a47-9172df628b68 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.151917 Oct 05 20:23:28.489160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 129/267] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:28 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:29.352404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:29.353641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:29.366268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:29.367164 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:29.367780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:29.368515 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:29.368977 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:29.369445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:29.485415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:29.486096 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:29.491968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:29.492516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:29.492948 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:29.493658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:29.494108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:29.494524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:29.613652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:29.621256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-11ec2ce0-ca61-4d16-ba52-4a87b6f349e1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.272823 Oct 05 20:23:29.621859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 139/268] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:29 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:29.625280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:29.632726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:29.633012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e7a8e8d1-d8ba-44be-b556-f88f06abde46 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.152784 Oct 05 20:23:29.633328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:29.633595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 130/269] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:29 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:29.639662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:29.640200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:29.640705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:29.641471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:29.642039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:29.642550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:29.861121 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:29.879567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-89186417-4ff1-46c7-bf6d-9488e74f5207 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.249653 Oct 05 20:23:29.880379 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 140/270] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:29 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:30.645890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:30.646772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:30.656584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:30.657262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:30.657411 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:30.657871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:30.658315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:30.659140 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:30.659602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:30.660032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:30.665759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:30.666378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:30.666943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:30.667753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:30.668307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:30.669339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:30.810637 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:30.813034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:30.822289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-548ddde0-40c3-44ca-9099-42fc7b84081f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.181534 Oct 05 20:23:30.822894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 131/271] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:30 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:30.904780 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:30.905486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:30.916091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:30.916676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:30.917181 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:30.918024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:30.918567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:30.919600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:31.070455 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:31.082256 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7b8c9bc7-efd2-480b-b811-38c746655194 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.182403 Oct 05 20:23:31.083074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 132/272] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:30 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:31.123870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:31.136026 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c8843d48-cf7f-4e1b-bb7c-d259cb5380d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.483734 Oct 05 20:23:31.137008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 141/273] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:30 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:31.844708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:31.845405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:31.851959 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:31.852577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:31.853171 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:31.854045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:31.854691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:31.855214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:31.999179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:32.006987 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8efecbce-6b42-4780-b809-f0804e8d1eaf tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.166504 Oct 05 20:23:32.007551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 133/274] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:31 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:32.106130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:32.107882 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:32.114430 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:32.114917 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:32.115520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:32.116221 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:32.116681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:32.117105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:32.159743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:32.160413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:32.166752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:32.167242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:32.167683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:32.168397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:32.168888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:32.169318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:32.277356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:32.287587 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-eb510db8-c375-460a-bd44-b65c14be5531 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.185579 Oct 05 20:23:32.288619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 142/275] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:32 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:32.312922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:32.320850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-fe009a0a-8aa8-4638-8d1d-cde8354ecb5e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.165169 Oct 05 20:23:32.321418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 134/276] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:32 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:33.029889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:33.030588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:33.036438 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:33.036939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:33.037376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:33.038294 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:33.038760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:33.039190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:33.178125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:33.187980 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ac383187-52c0-4205-b82b-024e32e158b0 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.161852 Oct 05 20:23:33.188975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 143/277] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:33 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:33.311255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:33.311899 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:33.318596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:33.319079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:33.319772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:33.320527 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:33.321247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:33.321570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:33.345195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:33.345839 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:33.354597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:33.355093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:33.355533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:33.356794 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:33.357257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:33.358177 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:33.519944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:33.526362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:33.528747 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e93c64f2-b6a5-412d-9475-213cee017c72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.187649 Oct 05 20:23:33.529332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 144/278] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:33 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:33.541343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-81ea47cf-eb14-4562-92b2-be89e65db513 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.228042 Oct 05 20:23:33.541343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 135/279] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:33 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:34.214694 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:34.215679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:34.222240 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:34.223071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:34.223864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:34.224679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:34.225404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:34.226097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:34.399410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:34.412374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-28ded9df-b0ba-4f52-bff1-988a4bc0e4c9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.203842 Oct 05 20:23:34.413283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 136/280] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:34 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:34.557701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:34.558502 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:34.558635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:34.562457 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:34.565934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:34.566429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:34.567126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:34.567844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:34.568299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:34.568734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:34.573651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:34.574613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:34.580396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:34.581339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:34.582004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:34.582827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:34.777624 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:34.787540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-eab7e70a-ca63-4be3-b2e4-aedca2dceb9b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1314 microversion: 2.1 time: 0.233534 Oct 05 20:23:34.788967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 137/281] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:34 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:34.792566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:34.802297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ce9c73e5-8ec1-4b0a-8af6-f21e07004861 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.251837 Oct 05 20:23:34.803727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 145/282] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:34 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:35.104418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-70d33ea7-8490-4c92-9b71-7f44e513054a req-2618d44a-3ab1-499f-930e-2c2617d4b8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c5126d-2b2b-4cc9-a187-511c93edaa78", "name": "network-vif-plugged", "status": "completed", "tag": "ab41397f-21da-4863-a97b-9e600a47ad52"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:35.122855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-70d33ea7-8490-4c92-9b71-7f44e513054a req-2618d44a-3ab1-499f-930e-2c2617d4b8fd service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.123559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-70d33ea7-8490-4c92-9b71-7f44e513054a req-2618d44a-3ab1-499f-930e-2c2617d4b8fd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.123988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-70d33ea7-8490-4c92-9b71-7f44e513054a req-2618d44a-3ab1-499f-930e-2c2617d4b8fd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:35.141784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-70d33ea7-8490-4c92-9b71-7f44e513054a req-2618d44a-3ab1-499f-930e-2c2617d4b8fd service nova] Creating event network-vif-plugged:ab41397f-21da-4863-a97b-9e600a47ad52 for instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 on hv-cinder-80152 Oct 05 20:23:35.148368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-70d33ea7-8490-4c92-9b71-7f44e513054a req-2618d44a-3ab1-499f-930e-2c2617d4b8fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048266 Oct 05 20:23:35.149279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 138/283] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:35.437071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:35.437856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:35.444488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.445166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.445741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:35.446700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.447297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.447825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:35.825295 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:35.826805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:35.835564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.836066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.836512 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:35.837215 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.837871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.838292 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:35.863716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:35.875435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5d18a786-3af0-4151-9ccb-a255953ff1ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.442824 Oct 05 20:23:35.877628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 146/284] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:35 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:35.895064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:35.895751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:35.912655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.913319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.914135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:35.915022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:35.917148 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:35.917699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:36.039344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:36.047859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d965e365-c504-4ec1-be6d-bf49c329d1fb tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1498 microversion: 2.1 time: 0.228318 Oct 05 20:23:36.048531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 139/285] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:35 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1498 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:36.214149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:36.225930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-518a5318-86d0-45e9-a515-ca4720e19c65 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.346186 Oct 05 20:23:36.227814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 147/286] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:35 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:36.900351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:36.901968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:36.911923 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:36.912630 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:36.913208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:36.914117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:36.914711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:36.915266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:37.110061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:37.120409 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a2a225ce-12d4-4da6-919a-648fa87b0ccd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.224575 Oct 05 20:23:37.123509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 140/287] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:36 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:37.255040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:37.255744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:37.271220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:37.271968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:37.272569 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:37.273449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:37.274063 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:37.276940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:37.529288 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:37.537430 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a5911854-a448-49cd-96bd-f5298dc648c1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.290817 Oct 05 20:23:37.538325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 148/288] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:37 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:38.062946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e33bd357-e33d-46bb-8abd-7f928c9c8bea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: .version_select at 0x7f3e02904d30>, body: {"keypair": {"name": "tempest-keypair-1985780925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGfhr7vHtd9G5hL1S7D1nEeQlYUN/vuSDxsXqEp2A8G+06ri7fz+2YWAm5lcQmHivPb7EgBip1voLXFy6zmcuEwJmNPOOgjNZbpQHE1W5Vw73Gp5KhPXknJFpYqZTBfvw=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:38.079151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-e33bd357-e33d-46bb-8abd-7f928c9c8bea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:23:38.083727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-e33bd357-e33d-46bb-8abd-7f928c9c8bea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:23:38.107733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e33bd357-e33d-46bb-8abd-7f928c9c8bea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.172587 Oct 05 20:23:38.108362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 141/289] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:23:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:38.148892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:38.149529 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:38.160364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:38.160863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:38.161308 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:38.162057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:38.162517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:38.162943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:38.385626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:38.396709 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f5dff1cd-4da4-4708-a34a-d33d51a7a6e9 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.251654 Oct 05 20:23:38.404823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 149/290] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:38 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:38.560612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:38.561458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:38.568005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:38.568851 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:38.569365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:38.570179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:38.570764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:38.571735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:38.854932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:38.855437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:38.868714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:38.873570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:38.875242 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:38.877328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:38.879143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:38.881618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:38.919311 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:23:38.969644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:38.979870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bb5b6d01-6faa-4030-9d8b-f11706c9637f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1521 microversion: 2.1 time: 0.423348 Oct 05 20:23:38.980463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 142/291] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:38 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1521 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:39.098978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7e19a189-cd3e-40af-b313-fd853a641a39 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 204 len: 0 microversion: 2.1 time: 0.249143 Oct 05 20:23:39.099575 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 150/292] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:23:38 2022] DELETE /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:23:39.108212 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:39.108839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:39.120297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:39.120742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:39.121226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:39.121981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:39.122436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:39.123003 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:39.315583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:39.331692 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6176b5ed-3c0b-4c95-bcc2-55a455cfba7e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1504 microversion: 2.1 time: 0.227507 Oct 05 20:23:39.332461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 143/293] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:39 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:39.429002 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:39.429738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:39.436763 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:39.437707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:39.438153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:39.438864 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:39.439311 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:39.439757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:39.679509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:39.687182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-55aaf60d-cb02-4196-b6fe-1ef45ac93126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.263476 Oct 05 20:23:39.687742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 151/294] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:39 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:39.900904 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1109477678", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b866581-0156-4c8b-8621-7be5c67dfe5d"}], "security_groups": [{"name": "tempest-securitygroup--605903801"}], "key_name": "tempest-keypair-1985780925", "user_data": "}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:40.006682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] validate_networks() for [('9b866581-0156-4c8b-8621-7be5c67dfe5d', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:23:40.007640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:40.008262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:40.017268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.017268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.017682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.018681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.019154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.019588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.166111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:40.173993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d892afb8-7cfa-46cb-aa30-b303c090b6de tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1501 microversion: 2.1 time: 0.171359 Oct 05 20:23:40.174784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 152/295] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:40 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1501 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:40.197014 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:40.197544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:40.204022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.204505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.204937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.206163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.206163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.206507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.352045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:40.356237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:40.362582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-17a7d839-9d23-4063-affa-2023fa83a6fc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1514 microversion: 2.1 time: 0.169398 Oct 05 20:23:40.363954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:40 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:40.389174 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:40.391674 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:40.406917 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.407518 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.408030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.408967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.409504 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.410185 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.429894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:23:40.430433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:23:40.430769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:23:40.431167 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:23:40.431571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:23:40.446984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.450461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.451702 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.453323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.454073 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.454507 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.487185 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:23:40.491761 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:23:40.504547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:23:40.507523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:23:40.545816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:40.571619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8e68bde7-2b9e-4134-a7d1-cba8946928e8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.674879 Oct 05 20:23:40.573368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 144/297] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:23:39 2022] POST /compute/v2.1/servers => generated 401 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:23:40.597126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-137e0c3d-2684-4be0-a0c5-85194479a4f9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:40.599610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-137e0c3d-2684-4be0-a0c5-85194479a4f9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:40.632419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:40.641562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d869a8e8-26a4-455f-b6ab-4b5a9c99388f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1504 microversion: 2.1 time: 0.270320 Oct 05 20:23:40.642165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 154/298] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:40 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:40.713139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:40.714054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:40.726625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.727135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.728298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.729073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:40.729734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:40.730346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:40.782505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-137e0c3d-2684-4be0-a0c5-85194479a4f9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:40.795326 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-137e0c3d-2684-4be0-a0c5-85194479a4f9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1242 microversion: 2.1 time: 0.205776 Oct 05 20:23:40.801897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 145/299] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:40 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:41.011074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:41.019408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ea08fe5f-fab2-4431-9022-09c1f92b0618 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.310887 Oct 05 20:23:41.022223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 155/300] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:40 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:41.665281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:41.665932 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:41.672560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:41.673380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:41.673846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:41.674573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:41.675024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:41.675606 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:41.821056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:41.827895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:41.829967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0b26f54b-2108-4553-86e4-e8b514bae842 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1504 microversion: 2.1 time: 0.168427 Oct 05 20:23:41.830681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 146/301] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:41 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:41.831099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:41.840087 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:41.840607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:41.841075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:41.841812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:41.842295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:41.842741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:41.907266 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:41.915267 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b2b6b99d-2816-4a66-984f-9d29f5277365 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1246 microversion: 2.1 time: 0.095585 Oct 05 20:23:41.915856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 156/302] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:41 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:42.044369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:42.044988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:42.050950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:42.051427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:42.051855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:42.063990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:42.063990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:42.063990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:42.190808 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:42.200048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-690b28c0-5b8b-4d01-9a13-fe3ad23d373f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.159487 Oct 05 20:23:42.200617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 147/303] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:42 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:42.852786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:42.853616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:42.860298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:42.860782 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:42.861220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:42.861965 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:42.862426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:42.862852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:42.938275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:42.939008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:42.945422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:42.945968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:42.946440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:42.947170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:42.947625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:42.948051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:42.992696 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:43.001013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5f2d5592-e185-4736-9724-796c463651db tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1504 microversion: 2.1 time: 0.152075 Oct 05 20:23:43.001592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 157/304] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:42 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:43.009781 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:43.017315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dea75ddf-3659-403c-9aeb-bb207615bc05 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1246 microversion: 2.1 time: 0.083571 Oct 05 20:23:43.017905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 148/305] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:42 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:43.222312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:43.222950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:43.228849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:43.229337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:43.229815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:43.230507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:43.231475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:43.231900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:43.364854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:43.372814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-31aa7815-fb5a-4392-b1ef-90bb1790bcf1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.154261 Oct 05 20:23:43.373382 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 158/306] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:43 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:44.023642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:44.024289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:44.030797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:44.031277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:44.031716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:44.032402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:44.032858 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:44.033280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:44.039848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:44.040613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:44.047517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:44.048395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:44.048504 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:44.049241 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:44.049753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:44.050195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:44.120555 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:44.128948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-432bc9ac-3275-425b-a4b7-6447f4564b97 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1246 microversion: 2.1 time: 0.092915 Oct 05 20:23:44.129532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 159/307] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:44 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1246 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:44.178444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:44.186620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-90045629-e037-42dd-9473-e7e35b1d7b02 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1504 microversion: 2.1 time: 0.166921 Oct 05 20:23:44.187172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 149/308] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:44 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:44.395254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:44.395867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:44.402097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:44.402632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:44.403164 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:44.403871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:44.404378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:44.404799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:44.533395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:44.541263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-32047116-5502-4f66-a208-ceacd1a31204 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.149815 Oct 05 20:23:44.541856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 160/309] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:44 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:45.153137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:45.154203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:45.160759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.161418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.165438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.165438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.165438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.165438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.211003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:45.211707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:45.220564 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.223660 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.225617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.228030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.228724 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.229369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.248624 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:45.257277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-92092b52-6bd5-4fe8-a7df-c36d36b8be98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1294 microversion: 2.1 time: 0.108601 Oct 05 20:23:45.274263 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 150/310] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:45 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1294 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:45.284872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:45.287800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:45.295503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.296812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.297763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.298791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.299437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.300059 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.329656 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'flavor' on Instance uuid f4856b5d-d049-4ee8-9b69-ba630f8d128f {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:23:45.332132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:45.448417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-112d5608-47e2-4512-a956-8e22931e447e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/action" status: 200 len: 32 microversion: 2.1 time: 0.168551 Oct 05 20:23:45.454440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 151/311] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:23:45 2022] POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:23:45.456533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:45.460815 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:45.461750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:45.468635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-506b2579-7d25-4872-8a84-1dec8f3fc203 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1504 microversion: 2.1 time: 0.262108 Oct 05 20:23:45.469445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 161/312] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:45 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:45.473577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.474239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.475183 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.475967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.476479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.476910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.565185 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:45.565936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:45.572679 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.573347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.573992 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.575431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.576028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.577223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.697537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:45.705878 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1dd764d8-3e9e-417e-837e-41454afce21a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.249882 Oct 05 20:23:45.706529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 152/313] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:45 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:45.711008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-1748a1e3-508f-4b09-8d79-4a68c1c8f0e5 req-e4c7688c-65fb-4498-94ff-c487dd7f9f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8", "name": "network-vif-deleted", "tag": "26a29d99-0bbb-4f57-ac65-df7736b3776c"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:45.720013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1748a1e3-508f-4b09-8d79-4a68c1c8f0e5 req-e4c7688c-65fb-4498-94ff-c487dd7f9f6b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:45.720483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1748a1e3-508f-4b09-8d79-4a68c1c8f0e5 req-e4c7688c-65fb-4498-94ff-c487dd7f9f6b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:45.720906 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1748a1e3-508f-4b09-8d79-4a68c1c8f0e5 req-e4c7688c-65fb-4498-94ff-c487dd7f9f6b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:45.731592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-1748a1e3-508f-4b09-8d79-4a68c1c8f0e5 req-e4c7688c-65fb-4498-94ff-c487dd7f9f6b service nova] Creating event network-vif-deleted:26a29d99-0bbb-4f57-ac65-df7736b3776c for instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 on hv-cinder-80152 Oct 05 20:23:45.736750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-1748a1e3-508f-4b09-8d79-4a68c1c8f0e5 req-e4c7688c-65fb-4498-94ff-c487dd7f9f6b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028988 Oct 05 20:23:45.737373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 153/314] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:45.749739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:45.757309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1accaa08-d8d4-4690-b789-7da3a70da526 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1318 microversion: 2.1 time: 0.196143 Oct 05 20:23:45.758172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 162/315] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:45 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:46.280722 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:46.281440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:46.287436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.287907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.288363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.289048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.289496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.289938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.379134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:46.387546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-731af9a7-33f0-447c-8645-ba8888ebbba5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1294 microversion: 2.1 time: 0.110958 Oct 05 20:23:46.388548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 154/316] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:46 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:46.492380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:46.493232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:46.500962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.500962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.500962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.501682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.502210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.502776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.568932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:46.577018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-136f992f-6236-4ae1-9fb4-ce66acd0ad28 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1299 microversion: 2.1 time: 0.088680 Oct 05 20:23:46.577827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 163/317] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:46 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:46.730647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:46.730647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:46.736491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.737227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.737818 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.738718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.739278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.740699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.781094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:46.781726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:46.790028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.790748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.791338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:46.792202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:46.792805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:46.793375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:47.007289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:47.020320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c741a7dc-e040-44d1-bd36-d46d42bf0a73 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.295027 Oct 05 20:23:47.021124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 155/318] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:46 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:47.034736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:47.049618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9628e5de-c461-489e-8ef1-99db951855dd tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1507 microversion: 2.1 time: 0.272815 Oct 05 20:23:47.050469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 164/319] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:46 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:47.414041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:47.414041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:47.420272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:47.421093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:47.421848 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:47.422714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:47.423321 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:47.423915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:47.517603 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:47.525371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-68804635-8f3e-44f7-b591-d6749278ecdb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1300 microversion: 2.1 time: 0.117641 Oct 05 20:23:47.525985 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 156/320] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:47 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1300 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:47.603551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:47.604737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:47.613356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:47.614138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:47.614795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:47.615745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:47.617345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:47.618008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:47.663699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:47.664303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:47.665460 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:47.665994 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lazy-loading 'fault' on Instance uuid 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:23:47.725249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:47.735524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-024f97b8-646a-4abe-b045-5cc12b3ac0fa tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 200 len: 1304 microversion: 2.1 time: 0.135947 Oct 05 20:23:47.736068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 165/321] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:47 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:48.046412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:48.047024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:48.060261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.060775 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.061183 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.061923 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.062412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.062785 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.228503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:48.249668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1bd6c7fa-9019-4c75-baf1-a595de9842ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.207758 Oct 05 20:23:48.252152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 157/322] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:48 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:48.550184 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:48.550775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:48.556640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.557118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.557789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.558481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.559739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.560161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.758773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:48.759349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:48.759888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:48.765984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.766581 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.766807 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-76bca1e3-ecf1-4b08-a969-ab565b23af2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.220425 Oct 05 20:23:48.767204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.767471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 166/323] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:48 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:48.771720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.772402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.772944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.789262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] HTTP exception thrown: Instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 could not be found. Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Request method failure captured: Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 HTTP/1.1 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPeejdf0GpsocqYPd9L97mBtyOYT3vCBZCMhrJMypsd6VI1tFbJZIHyQ8JkCUl1iHUxbBkd1noBPLNfwDieXqFvY5By1ZG0-cj7RMd6tjokh90dHBS8O13HnCjU1tTOJlNlkRV6WQT6tjWVirfxy1-JCS6IJrDyWtDgZgDj_m7jwDKb0 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 25c983389ecf447c9ca4bd6ca01b5a32 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-VolumesActionsTest-1436632453 Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:23:48.791245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-VolumesActionsTest-1436632453 Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 25c983389ecf447c9ca4bd6ca01b5a32 Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-VolumesActionsTest-1436632453 Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-VolumesActionsTest-1436632453-project Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 1b8c41cfa6854a528f43e82e0fb26220 Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-VolumesActionsTest-1436632453-project Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 could not be found. Oct 05 20:23:48.792616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8'} Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 could not be found. Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:23:48.794045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 could not be found. Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 could not be found. Oct 05 20:23:48.796117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:23:48.797172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Returning 404 to user: Instance 2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:23:48.797172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2c73c06a-c5c6-42a3-8744-687dc25239a9 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8" status: 404 len: 111 microversion: 2.1 time: 0.038270 Oct 05 20:23:48.797172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 158/324] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:48 2022] GET /compute/v2.1/servers/2f6fdebc-0b77-418e-ae0d-ea5dc53f3cb8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:23:48.842667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-d2dc6204-ec2e-43e1-ab46-722098c817dc req-3070f5e4-7b2e-4455-aa0e-86ec8b71a70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4189131-495b-4d78-9eb7-b69ea29c7b50", "tag": "ed1c8db8-3987-4cdb-be27-b92626517d7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:48.854762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d2dc6204-ec2e-43e1-ab46-722098c817dc req-3070f5e4-7b2e-4455-aa0e-86ec8b71a70e service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:48.856133 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d2dc6204-ec2e-43e1-ab46-722098c817dc req-3070f5e4-7b2e-4455-aa0e-86ec8b71a70e service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:48.856920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d2dc6204-ec2e-43e1-ab46-722098c817dc req-3070f5e4-7b2e-4455-aa0e-86ec8b71a70e service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:48.870825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-d2dc6204-ec2e-43e1-ab46-722098c817dc req-3070f5e4-7b2e-4455-aa0e-86ec8b71a70e service nova] Creating event network-changed:ed1c8db8-3987-4cdb-be27-b92626517d7e for instance d4189131-495b-4d78-9eb7-b69ea29c7b50 on hv-cinder-80152 Oct 05 20:23:48.877581 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-d2dc6204-ec2e-43e1-ab46-722098c817dc req-3070f5e4-7b2e-4455-aa0e-86ec8b71a70e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039748 Oct 05 20:23:48.878809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 167/325] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:48.920691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1288732808", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "networks": [{"uuid": "239503aa-bfd9-4c9f-872c-79484a7b0a69"}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:48.981484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] validate_networks() for [('239503aa-bfd9-4c9f-872c-79484a7b0a69', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:23:49.276149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:49.276842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:49.287769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:49.288820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:49.289495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:49.290492 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:49.291168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:49.292107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:49.487630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:49.495336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7d5ad248-8969-4080-83aa-4a6b2352df61 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.223364 Oct 05 20:23:49.496771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 168/326] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:49 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:49.608773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:23:49.609190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:23:49.609743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:23:49.610172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:23:49.610599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:23:49.620312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:49.621589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:49.622659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:49.623414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:49.623883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:49.624353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:49.643305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Getting quotas for project 25c983389ecf447c9ca4bd6ca01b5a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:23:49.647907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Getting quotas for user 1b8c41cfa6854a528f43e82e0fb26220 and project 25c983389ecf447c9ca4bd6ca01b5a32. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:23:49.659189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:23:49.661504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:23:49.710395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3390ca0f-201b-40a0-844e-aa2598861803 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.794203 Oct 05 20:23:49.711208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 159/327] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:23:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:23:49.724680 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5156c9fd-d9a7-4c43-9426-d92c9b8f2f78 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:49.725925 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5156c9fd-d9a7-4c43-9426-d92c9b8f2f78 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:49.790975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:49.801972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:49.801972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:49.801972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:49.801972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:49.802457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:49.802457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:49.802457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:49.802637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5156c9fd-d9a7-4c43-9426-d92c9b8f2f78 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:49.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5156c9fd-d9a7-4c43-9426-d92c9b8f2f78 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1214 microversion: 2.1 time: 0.091321 Oct 05 20:23:49.810810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 169/328] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:49 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:49.972434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:49.981058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b49aece2-7dea-471b-9f6a-dd18e0799c72 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.193754 Oct 05 20:23:49.981668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 160/329] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:49 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:50.518602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:50.519218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:50.525855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:50.526345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:50.526782 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:50.527994 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:50.528449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:50.528913 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:50.674962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:50.682790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8b4753c7-62df-4239-b5db-056144f6e9fd tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.168020 Oct 05 20:23:50.683354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 170/330] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:50 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:50.836823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:50.838046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:50.864167 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:50.864953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:50.865890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:50.867160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:50.868043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:50.868877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:50.966094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:50.977905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4b2f0931-2030-42a5-8093-967948cee8af tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1210 microversion: 2.1 time: 0.149241 Oct 05 20:23:50.978531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 161/331] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:50 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1210 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:51.006944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:51.007551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:51.016404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:51.017244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:51.017889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:51.019009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:51.019713 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:51.020400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:51.236289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:51.240291 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:51.247868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-04c1822a-c801-41ef-9a0a-a9e3a1ac98b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.245193 Oct 05 20:23:51.249158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 171/332] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:51 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:51.706340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:51.706962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:51.713074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:51.713716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:51.714185 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:51.714901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:51.715378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:51.715804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:51.860168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:51.868568 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d6f0b2f1-419c-4fae-a44a-510f069acd93 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.166600 Oct 05 20:23:51.869576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 162/333] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:51 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:52.000488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:52.001385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:52.007488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:52.008104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:52.008397 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:52.009087 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:52.009552 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:52.009978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:52.097557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:52.107865 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-85b2d238-cab5-4b2e-b40f-60c8052f78a0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1274 microversion: 2.1 time: 0.111423 Oct 05 20:23:52.110088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 172/334] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:51 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:52.273386 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:52.274702 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:52.281833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:52.282479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:52.283197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:52.284432 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:52.285151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:52.285691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:52.435939 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:52.461221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-29f2eac7-8b17-4379-bebf-907bdfafa302 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.191598 Oct 05 20:23:52.462053 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 163/335] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:52 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:52.893409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:52.894056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:52.900077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:52.900561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:52.900994 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:52.901716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:52.902190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:52.902777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:53.132501 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:53.133618 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:53.134610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:53.144200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c2f9bf2d-5628-4e88-9dc4-aedf5521f60d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.254575 Oct 05 20:23:53.144663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:53.145283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 173/336] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:52 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:53.145550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:53.146000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:53.146708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:53.147162 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:53.147586 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:53.285162 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:53.293756 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-52fc4646-1794-46ba-9edd-10219e2c524b tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.163702 Oct 05 20:23:53.294330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 164/337] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:53 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:53.485849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:53.486381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:53.492747 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:53.493254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:53.493715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:53.494423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:53.494880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:53.495339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:53.690996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:53.698885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8e2f7d75-6052-4106-8f3e-746899b3880f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.217171 Oct 05 20:23:53.699454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 174/338] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:53 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:53.854649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-38f2de67-f084-4bf9-bace-2dd3adcda1dc req-6662e23a-10bb-4554-a6e5-999cb225aa79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "337b8cef-1d31-4846-af34-178c3e57eb4d", "tag": "5d8e459f-5904-4508-80a0-375da8ce6e87"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:53.871071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-38f2de67-f084-4bf9-bace-2dd3adcda1dc req-6662e23a-10bb-4554-a6e5-999cb225aa79 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:53.871933 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-38f2de67-f084-4bf9-bace-2dd3adcda1dc req-6662e23a-10bb-4554-a6e5-999cb225aa79 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:53.872513 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-38f2de67-f084-4bf9-bace-2dd3adcda1dc req-6662e23a-10bb-4554-a6e5-999cb225aa79 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:53.901233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-38f2de67-f084-4bf9-bace-2dd3adcda1dc req-6662e23a-10bb-4554-a6e5-999cb225aa79 service nova] Creating event network-changed:5d8e459f-5904-4508-80a0-375da8ce6e87 for instance 337b8cef-1d31-4846-af34-178c3e57eb4d on hv-cinder-80152 Oct 05 20:23:53.910734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-38f2de67-f084-4bf9-bace-2dd3adcda1dc req-6662e23a-10bb-4554-a6e5-999cb225aa79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064452 Oct 05 20:23:53.911545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 165/339] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:23:54.169452 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:54.170671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:54.177350 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:54.177965 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:54.178479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:54.179262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:54.179832 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:54.180264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:54.334557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:54.335619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:54.343735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:54.344586 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:54.345494 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:54.347658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:54.348402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:54.349031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:54.395057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:54.403962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1797b27c-8982-42bb-83d6-f626b7e159a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.239879 Oct 05 20:23:54.404556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 175/340] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:54 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:54.485901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:54.493505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ceac28f9-e721-40a2-b1ae-19fc12c96e9f tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.165096 Oct 05 20:23:54.494085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 166/341] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:54 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:54.721904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:54.722506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:54.724360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:54.730013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:54.731013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:54.731451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:54.732142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:54.732598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:54.733052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:54.866562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:54.875039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f4d27c61-3ee0-4b03-9cf3-8e13e28bade1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.157180 Oct 05 20:23:54.875611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 176/342] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:54 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:55.428534 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:55.429137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:55.435089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:55.435589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:55.436017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:55.436695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:55.437140 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:55.437581 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:55.516836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:55.517451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:55.523820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:55.524301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:55.524731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:55.525420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:55.525918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:55.526341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:55.569711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:55.578155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e328135c-a85e-4224-b96e-46560948bfd3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.153429 Oct 05 20:23:55.578742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 167/343] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:55 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:55.659833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:55.667392 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a95c3a88-5d33-459d-84cc-f634989b82cd tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.154574 Oct 05 20:23:55.667973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 177/344] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:55 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:55.897707 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:55.898319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:55.904270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:55.904750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:55.905185 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:55.905916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:55.906369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:55.906794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:56.033993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:56.042138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-05108720-b2a1-46cb-b2dc-8d691ec10c0b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.148248 Oct 05 20:23:56.042786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 168/345] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:55 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:56.601618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:56.602227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:56.609618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:56.610099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:56.610534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:56.611222 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:56.611668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:56.612089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:56.690237 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:56.690965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:56.697282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:56.697800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:56.698235 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:56.698922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:56.699426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:56.699799 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:56.702485 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:56.745376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:56.753829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-942439af-680c-42c9-8525-23fa61ca582e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.156058 Oct 05 20:23:56.754404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 178/346] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:56 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:56.834505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:56.842084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f33d3ca8-5c7e-4f72-a10a-91f339fbd69a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.155709 Oct 05 20:23:56.842643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 169/347] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:56 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:57.065303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:57.065837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:57.072060 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:57.072544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:57.073007 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:57.073726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:57.074177 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:57.074604 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:57.207487 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:57.215433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7db3d94f-d667-4391-8965-3164f20f6234 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.154136 Oct 05 20:23:57.215991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 179/348] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:57 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:57.777950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:57.778478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:57.784367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:57.784842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:57.785270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:57.785980 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:57.786428 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:57.786845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:57.869093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:57.869700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:57.877034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:57.877540 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:57.877984 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:57.879089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:57.879089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:57.879517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:57.920597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:57.928824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-fcfbe30a-c4a5-4e56-9d28-304c63dfd1f8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.154802 Oct 05 20:23:57.929599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 170/349] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:57 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:58.010168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:58.017649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9f2b838c-f1ce-480b-8b51-58a14bb2803a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.152488 Oct 05 20:23:58.018213 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 180/350] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:57 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:58.238574 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:58.239616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:58.245835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:58.246332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:58.247371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:58.248076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:58.248532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:58.248958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:58.384510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:58.392681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3f6586f2-59ce-4870-97d2-e5a134811008 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.158530 Oct 05 20:23:58.393238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 171/351] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:58 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:58.953110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:58.953752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:58.960253 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:58.960740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:58.961182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:58.961905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:58.962365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:58.962794 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:59.040239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:59.040880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:59.047510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:59.047993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:59.048429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:59.049125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:59.049600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:59.050025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:59.094734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:59.102651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c953cdd3-cef3-4b2f-ae1d-8d6f43e38919 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.154140 Oct 05 20:23:59.103227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 181/352] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:58 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:59.186824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:59.194687 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5c61fa56-dfcc-400e-9e97-f07386ff7d8e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.158351 Oct 05 20:23:59.195249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 172/353] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:59 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:23:59.415502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:23:59.416152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:23:59.422373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:59.422867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:59.423366 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:59.424141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:59.424668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:59.425151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:59.628759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:23:59.638117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-225a1d18-2f37-4712-b624-745d3120c911 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.226607 Oct 05 20:23:59.638715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 182/354] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:23:59 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:23:59.858300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-3f14f51b-aafe-413b-99aa-77c22596ceed req-63d3f4af-4ed3-457e-b343-40e5c94b8212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4189131-495b-4d78-9eb7-b69ea29c7b50", "name": "network-vif-plugged", "status": "completed", "tag": "ed1c8db8-3987-4cdb-be27-b92626517d7e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:23:59.868323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=4 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:59.869694 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=18 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:23:59.873210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-3f14f51b-aafe-413b-99aa-77c22596ceed req-63d3f4af-4ed3-457e-b343-40e5c94b8212 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:23:59.875988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-3f14f51b-aafe-413b-99aa-77c22596ceed req-63d3f4af-4ed3-457e-b343-40e5c94b8212 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:23:59.876931 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-3f14f51b-aafe-413b-99aa-77c22596ceed req-63d3f4af-4ed3-457e-b343-40e5c94b8212 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:23:59.891776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-3f14f51b-aafe-413b-99aa-77c22596ceed req-63d3f4af-4ed3-457e-b343-40e5c94b8212 service nova] Creating event network-vif-plugged:ed1c8db8-3987-4cdb-be27-b92626517d7e for instance d4189131-495b-4d78-9eb7-b69ea29c7b50 on hv-cinder-80152 Oct 05 20:23:59.897992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-3f14f51b-aafe-413b-99aa-77c22596ceed req-63d3f4af-4ed3-457e-b343-40e5c94b8212 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045225 Oct 05 20:23:59.898996 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 173/355] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:00.127386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:00.128909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:00.135283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:00.138862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:00.139556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:00.140157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:00.141097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:00.141828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:00.142255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:00.218774 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:00.219481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:00.225582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:00.226066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:00.226502 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:00.227447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:00.227659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:00.228085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:00.318534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:00.337784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5bf43a65-9a80-4ef5-8a70-27236713b646 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.214473 Oct 05 20:24:00.338370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 183/356] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:00 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:00.385249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:00.393505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9f16d932-bcc7-4c58-ba76-5cef99172e2a tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.180248 Oct 05 20:24:00.394087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 174/357] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:00 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:00.660804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:00.661407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:00.667445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:00.667929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:00.668401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:00.669084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:00.669560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:00.669985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:00.802265 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:00.811084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5315352a-83c8-4d1b-a1de-ad7c0c35017b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.154120 Oct 05 20:24:00.811773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 184/358] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:00 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:01.361915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:01.362528 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:01.368893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:01.369397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:01.369867 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:01.370594 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:01.371052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:01.372083 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:01.416218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:01.416900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:01.424179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:01.424782 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:01.425481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:01.426890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:01.427461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:01.427982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:01.580965 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:01.591002 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-29135c39-0a7d-4b0b-80e8-a35bc21d90d6 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.177895 Oct 05 20:24:01.591588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 185/359] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:01 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:01.605395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:01.618018 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7e3c23bf-4296-4a00-ae99-d56b3b16c338 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.260544 Oct 05 20:24:01.618614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 175/360] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:01 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:01.834712 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:01.835449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:01.844417 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:01.845195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:01.845776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:01.846360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:01.846817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:01.847238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:02.004783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:02.014543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-866313e4-a59a-4287-8bd5-3e663812e6c1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1367 microversion: 2.1 time: 0.184065 Oct 05 20:24:02.015137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 186/361] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:01 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:02.615092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:02.615697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:02.622304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:02.622771 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:02.623203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:02.623890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:02.624332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:02.624925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:02.648543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:02.649221 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:02.657550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:02.658164 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:02.658816 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:02.659541 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:02.660414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:02.660821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:02.773347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:02.782950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-14c7926f-396c-40a6-a579-4424a8f045e8 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.171688 Oct 05 20:24:02.783569 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 176/362] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:02 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:02.812151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:02.821842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-62d225cc-b67a-48e7-9806-d68ae9d1e1ce tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.177191 Oct 05 20:24:02.822508 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 187/363] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:02 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:03.035977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:03.036591 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:03.042456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.042945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.043383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.044072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.044525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.044948 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.178631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:03.187226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3fbd436f-4733-438d-9512-22dad217b267 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1558 microversion: 2.1 time: 0.154777 Oct 05 20:24:03.187790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 177/364] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:03 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:03.209981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:03.210474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:03.217104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.217794 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.218340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.218905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.219362 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.219943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.240783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:03.307384 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d00950f8-e3c6-472c-815e-795f3eae823b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101164 Oct 05 20:24:03.307974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 188/365] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:24:03 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:03.809641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:03.812297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-ef10936b-7cb1-4563-b6bc-ede5adc8ed41 req-9e402428-36c2-48b8-b378-315cc786685b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337b8cef-1d31-4846-af34-178c3e57eb4d", "name": "network-vif-plugged", "status": "completed", "tag": "5d8e459f-5904-4508-80a0-375da8ce6e87"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:03.813350 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:03.836904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.838460 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.846584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.848347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.848818 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-ef10936b-7cb1-4563-b6bc-ede5adc8ed41 req-9e402428-36c2-48b8-b378-315cc786685b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.849371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-ef10936b-7cb1-4563-b6bc-ede5adc8ed41 req-9e402428-36c2-48b8-b378-315cc786685b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.850000 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.850426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.853600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-ef10936b-7cb1-4563-b6bc-ede5adc8ed41 req-9e402428-36c2-48b8-b378-315cc786685b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.874300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-ef10936b-7cb1-4563-b6bc-ede5adc8ed41 req-9e402428-36c2-48b8-b378-315cc786685b service nova] Creating event network-vif-plugged:5d8e459f-5904-4508-80a0-375da8ce6e87 for instance 337b8cef-1d31-4846-af34-178c3e57eb4d on hv-cinder-80152 Oct 05 20:24:03.903094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-ef10936b-7cb1-4563-b6bc-ede5adc8ed41 req-9e402428-36c2-48b8-b378-315cc786685b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103295 Oct 05 20:24:03.904182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 178/366] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:03.910590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:03.911440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:03.920014 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.920814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.921257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:03.921990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:03.922655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:03.923084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:04.110856 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:04.118791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-63b6e4b6-8ad5-48df-9078-1040cbe134dc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.213356 Oct 05 20:24:04.119475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 179/367] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:03 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:04.158067 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:04.165827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4d0dba63-3482-4cdb-83f7-00d32a7bec34 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.363114 Oct 05 20:24:04.166591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 189/368] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:03 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:04.865481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-4874aab5-cc81-4515-a179-0ba347c55ba4 req-df03637f-4f50-451b-8351-7a0819f51f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4189131-495b-4d78-9eb7-b69ea29c7b50", "tag": "ed1c8db8-3987-4cdb-be27-b92626517d7e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:04.877708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4874aab5-cc81-4515-a179-0ba347c55ba4 req-df03637f-4f50-451b-8351-7a0819f51f5f service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:04.878040 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4874aab5-cc81-4515-a179-0ba347c55ba4 req-df03637f-4f50-451b-8351-7a0819f51f5f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:04.878390 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4874aab5-cc81-4515-a179-0ba347c55ba4 req-df03637f-4f50-451b-8351-7a0819f51f5f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:04.890434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-4874aab5-cc81-4515-a179-0ba347c55ba4 req-df03637f-4f50-451b-8351-7a0819f51f5f service nova] Creating event network-changed:ed1c8db8-3987-4cdb-be27-b92626517d7e for instance d4189131-495b-4d78-9eb7-b69ea29c7b50 on hv-cinder-80152 Oct 05 20:24:04.895611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-4874aab5-cc81-4515-a179-0ba347c55ba4 req-df03637f-4f50-451b-8351-7a0819f51f5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034530 Oct 05 20:24:04.896681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 180/369] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:05.144116 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:05.144719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:05.152377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:05.153292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:05.154046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:05.154742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:05.155389 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:05.155808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:05.190564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:05.191261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:05.202080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:05.202646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:05.203086 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:05.203793 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:05.204247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:05.204679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:05.349484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:05.358111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ae09539d-3c5a-443f-8fdb-5c718a840afe tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1314 microversion: 2.1 time: 0.172099 Oct 05 20:24:05.361557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 181/370] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:05 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:05.372018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:05.381227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d8ffc81d-cca0-43f1-9042-65ad30a19d84 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.241200 Oct 05 20:24:05.382166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 190/371] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:05 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:05.575341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:05.575965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:05.587490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:05.587993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:05.588428 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:05.589297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:05.589970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:05.590546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:05.635920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-455ef593-c51f-4505-93bb-6057e138c01d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/ips" status: 200 len: 147 microversion: 2.1 time: 0.065635 Oct 05 20:24:05.639178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 182/372] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:24:05 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/ips => generated 147 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:06.381585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:06.382318 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:06.389431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:06.389936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:06.390376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:06.391074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:06.391531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:06.391955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:06.404191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:06.405784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:06.411974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:06.412536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:06.413034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:06.413769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:06.414387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:06.414817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:06.537150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:06.545499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fe8b4a3f-cd5f-4984-944d-7894ffbb613c tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1498 microversion: 2.1 time: 0.167732 Oct 05 20:24:06.546284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 191/373] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:06 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:06.564792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:06.573945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b86b25d4-5d70-4550-a44d-ce3e85ec73ca tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.173658 Oct 05 20:24:06.586467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 183/374] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:06 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:07.597760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:07.598363 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:07.604881 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:07.605357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:07.605847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:07.606527 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:07.607065 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:07.607382 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:07.746130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:07.747496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:07.750262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:07.755010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:07.755598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:07.756116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:07.756900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:07.757379 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:07.757903 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:07.760119 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7deda4de-964f-4b8a-ba57-5cf3d532709c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.166584 Oct 05 20:24:07.781630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 192/375] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:07 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:07.796564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:24:07.865313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:07.885346 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-80e1f14f-55e9-42f4-b936-de4e65700892 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "DELETE /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 204 len: 0 microversion: 2.1 time: 0.142932 Oct 05 20:24:07.886051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 184/376] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:24:07 2022] DELETE /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 20:24:07.895904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:07.896510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:07.903108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:07.903600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:07.904031 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:07.904731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:07.905179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:07.905644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:08.065573 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:08.074331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4310b3e0-66c8-4aed-a166-439996e74c63 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1504 microversion: 2.1 time: 0.183037 Oct 05 20:24:08.074895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 193/377] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:07 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:08.788781 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:08.789476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:08.796321 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:08.796820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:08.797257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:08.797967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:08.798418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:08.798834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:08.953966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:08.961636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-644be6ac-ed6c-4329-8f2e-d4137e746ab5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.177324 Oct 05 20:24:08.962191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 185/378] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:08 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:09.097050 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:09.098235 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:09.106076 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.106558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.106986 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.108184 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.108638 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.109056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.245923 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:09.254053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3818e3eb-0c1d-4642-81bb-f6182b83ee99 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1504 microversion: 2.1 time: 0.160958 Oct 05 20:24:09.255590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 194/379] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:09 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:09.298386 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:09.298887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:09.304701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.305191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.305663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.306363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.306822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.307254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.320822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:09.331977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a27e5c7a-1083-467b-a090-85d1f56addfa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/ips" status: 200 len: 150 microversion: 2.20 time: 0.037543 Oct 05 20:24:09.332720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 186/380] 10.222.0.23 () {60 vars in 1289 bytes} [Wed Oct 5 20:24:09 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:24:09.959341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34a8e199-2af3-493e-89e0-5a75475a08d3", "device": "/dev/sdb"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:09.962369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:09.968437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.969046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.969558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.970253 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.970708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.971130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.987059 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:09.987672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:09.995839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.996876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.997318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:09.998470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:09.998936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:09.999773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:10.143263 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:10.151491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e6fe8bca-4429-463d-b3ed-6e54406a1196 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.168741 Oct 05 20:24:10.152109 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 187/381] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:09 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:10.277163 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:10.278017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:10.284302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:10.284773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:10.285154 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:10.285918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:10.286365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:10.286783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:10.428308 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:10.436026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a1811c01-fe85-4e66-b068-9e927bbf8366 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1504 microversion: 2.1 time: 0.162780 Oct 05 20:24:10.436590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 188/382] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:10 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:10.652866 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e5e3e05f-c304-4abc-b008-0719073daa71 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "POST /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.697114 Oct 05 20:24:10.653532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 195/383] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:24:09 2022] POST /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:11.176972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:11.177658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:11.183451 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.184013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.184496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:11.185146 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.185624 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.186042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:11.249450 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-8f1b4cc4-0193-4a47-96ab-b34cecf185a0 req-0e538db8-00af-4121-9286-9885086b7772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "337b8cef-1d31-4846-af34-178c3e57eb4d", "name": "network-vif-deleted", "tag": "5d8e459f-5904-4508-80a0-375da8ce6e87"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:11.259610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-8f1b4cc4-0193-4a47-96ab-b34cecf185a0 req-0e538db8-00af-4121-9286-9885086b7772 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.260200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-8f1b4cc4-0193-4a47-96ab-b34cecf185a0 req-0e538db8-00af-4121-9286-9885086b7772 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.260642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-8f1b4cc4-0193-4a47-96ab-b34cecf185a0 req-0e538db8-00af-4121-9286-9885086b7772 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:11.272458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-8f1b4cc4-0193-4a47-96ab-b34cecf185a0 req-0e538db8-00af-4121-9286-9885086b7772 service nova] Creating event network-vif-deleted:5d8e459f-5904-4508-80a0-375da8ce6e87 for instance 337b8cef-1d31-4846-af34-178c3e57eb4d on hv-cinder-80152 Oct 05 20:24:11.277989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-8f1b4cc4-0193-4a47-96ab-b34cecf185a0 req-0e538db8-00af-4121-9286-9885086b7772 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032770 Oct 05 20:24:11.278584 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 196/384] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:11.317832 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:11.325461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9a7b9a0b-50ff-427b-ba76-3020c5cc092f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.152468 Oct 05 20:24:11.326051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 189/385] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:11 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:11.460714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:11.461421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:11.468086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.468580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.469038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:11.469762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.470241 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.470668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:11.533942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:11.541695 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5bad1f77-e0c0-44dc-9532-0921e6ef2b61 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1462 microversion: 2.1 time: 0.085544 Oct 05 20:24:11.542260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 197/386] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:11 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:11.907275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d9308f0-8799-4c26-961c-fde21921b453"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:11.909720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:11.916085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.916578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.917018 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:11.917749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:11.918769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:11.919201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.348621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:12.349084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:12.356635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.357370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.358024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.359039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.359706 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.360345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.502273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2572480e-258f-437c-8a63-e67991cba7e8 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598684 Oct 05 20:24:12.502955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 190/387] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:24:11 2022] POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:12.509753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:12.513094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:12.525891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.526953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.528432 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.529232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.530080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.530517 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.555182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:12.557353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lazy-loading 'flavor' on Instance uuid 1f20ad33-5d0e-4324-b1b5-c8f823457933 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:24:12.566582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d8da9a1d-5af2-461a-a4c6-0230099021d1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.220990 Oct 05 20:24:12.574400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 198/388] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:12 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:12.579754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:12.580603 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:12.587255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.587688 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.588126 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.588830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.589286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.589792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.622715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.623520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.624028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.624479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lazy-loading 'fault' on Instance uuid 337b8cef-1d31-4846-af34-178c3e57eb4d {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:24:12.667074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:12.676436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1952f12c-2b16-42a1-8418-6d2fe2ddde0e tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1304 microversion: 2.1 time: 0.100518 Oct 05 20:24:12.677093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 199/389] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:12 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:12.749250 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c5564d4d-ad28-422d-ac5b-b3988de5d292 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/action" status: 202 len: 0 microversion: 2.20 time: 0.244647 Oct 05 20:24:12.749861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 191/390] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Oct 5 20:24:12 2022] POST /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:24:12.757935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:12.758544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:12.764488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.764960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.765388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.766086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:12.766532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:12.766947 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:12.915731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:12.924445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:12.925930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:12.927085 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dab94bbc-242f-4e67-a008-48d08c769c23 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.172938 Oct 05 20:24:12.927667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 200/391] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:12 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:13.592573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:13.593276 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:13.600650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.601132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.601774 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:13.602621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.603246 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.604317 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:13.700767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:13.701377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:13.707671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.708252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.708719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:13.709478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.709960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.710393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:13.743562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:13.743705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.744068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.744505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:13.744955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lazy-loading 'fault' on Instance uuid 337b8cef-1d31-4846-af34-178c3e57eb4d {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:24:13.752303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dc9886e7-eb59-474d-adae-5bb1f834543e tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.164530 Oct 05 20:24:13.752958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 192/392] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:13 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:13.790738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:13.799551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-28bdc850-76dc-49f3-87ab-af5a5bb32fa0 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1304 microversion: 2.1 time: 0.103251 Oct 05 20:24:13.800125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 201/393] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:13 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:13.956119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:13.956736 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:13.962905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.963389 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.963828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:13.964541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:13.965023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:13.965448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.095619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:14.104152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:14.105637 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:14.106798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dd1526cb-3c01-4ff4-8ea6-330f723281b9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.154722 Oct 05 20:24:14.107353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 193/394] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:13 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:14.775525 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:14.776163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:14.782463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.782937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.783364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.784035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.784478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.784890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.822650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:14.823386 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:14.829864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.830349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.830784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.831482 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.831936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.832364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.863054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.863452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.863888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.864536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lazy-loading 'fault' on Instance uuid 337b8cef-1d31-4846-af34-178c3e57eb4d {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:24:14.908497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8c41cfa6854a528f43e82e0fb26220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25c983389ecf447c9ca4bd6ca01b5a32', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:14.916172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e94f8600-7858-4970-bd48-fb8b07cebda3 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 200 len: 1304 microversion: 2.1 time: 0.097361 Oct 05 20:24:14.916745 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 194/395] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:14 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:14.920561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:14.928476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3ec6ed1f-16a1-4626-95c7-4cc80b5a4abc tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1500 microversion: 2.1 time: 0.157324 Oct 05 20:24:14.929021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 202/396] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:14 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:14.952124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a76a6dd-d015-4c3c-a976-9696c66bcc41"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:14.954560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:14.960298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.960779 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.961222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.961945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:14.962433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:14.962862 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:14.989082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] HTTP exception thrown: Cannot 'attach_volume' instance f4856b5d-d049-4ee8-9b69-ba630f8d128f while it is in vm_state rescued Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Request method failure captured: Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/os-volume_attachments HTTP/1.1 Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 74 Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedipfPsghRxxr8JlXcA2OmTImyDJvKLT3ZxMSlNAaUg5XrSN9-akXCc_X8qyP0_ov5Kj8oFZRZM2CHjBRJRku916eEt1KspjId-ZunLkvqg2zi9a4bevsPaQ5xOs0KdcCUV4-Hd_9jKawtqrxpUAdLhl_ELaEi3U0IRlhNl4hufYdg Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:24:14.990821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07f868da50254a68bc692bca433d2699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07f868da50254a68bc692bca433d2699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 1301a78c1a684c94acb9f26b56f39f21 Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {"volumeAttachment": {"volumeId": "1a76a6dd-d015-4c3c-a976-9696c66bcc41"}} Oct 05 20:24:14.992328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Cannot 'attach_volume' instance f4856b5d-d049-4ee8-9b69-ba630f8d128f while it is in vm_state rescued Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'server_id': 'f4856b5d-d049-4ee8-9b69-ba630f8d128f', 'body': {'volumeAttachment': {'volumeId': '1a76a6dd-d015-4c3c-a976-9696c66bcc41'}}} Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:24:14.993196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f4856b5d-d049-4ee8-9b69-ba630f8d128f while it is in vm_state rescued Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:24:14.994493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f4856b5d-d049-4ee8-9b69-ba630f8d128f while it is in vm_state rescued Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Returning 409 to user: Cannot 'attach_volume' instance f4856b5d-d049-4ee8-9b69-ba630f8d128f while it is in vm_state rescued {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6a5f7858-5b83-48cc-b94c-bf3f70733258 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044932 Oct 05 20:24:14.995669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 195/397] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:24:14 2022] POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 20:24:15.003581 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:15.004277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:15.010771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.011342 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.012670 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.013451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.013949 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.014385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.055099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:15.083678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7b0097a1-728f-4ceb-a656-d46c6709d22f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/action" status: 202 len: 0 microversion: 2.1 time: 0.085688 Oct 05 20:24:15.084590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 203/398] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:24:14 2022] POST /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:24:15.097961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:15.099306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:15.107829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.108580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.110350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.111984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.112513 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.113008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.133434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:15.134231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:15.141295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.141882 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.142322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.143016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.143468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.144017 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.266227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:15.274575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2368f93d-7cc9-45ed-8538-add52f641894 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1508 microversion: 2.1 time: 0.185532 Oct 05 20:24:15.275233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 196/399] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:15 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1508 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:15.361087 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:15.369285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:15.370759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:15.371906 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-baf13ff5-671b-4bdb-85e4-3af05e255f2d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.243202 Oct 05 20:24:15.372455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 204/400] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:15 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:15.939474 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:15.940089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] [instance: 337b8cef-1d31-4846-af34-178c3e57eb4d] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:15.946190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.946668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.947106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.947805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:15.948260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:15.948681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:15.964353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] HTTP exception thrown: Instance 337b8cef-1d31-4846-af34-178c3e57eb4d could not be found. Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Request method failure captured: Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d HTTP/1.1 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPeejdf0GpsocqYPd9L97mBtyOYT3vCBZCMhrJMypsd6VI1tFbJZIHyQ8JkCUl1iHUxbBkd1noBPLNfwDieXqFvY5By1ZG0-cj7RMd6tjokh90dHBS8O13HnCjU1tTOJlNlkRV6WQT6tjWVirfxy1-JCS6IJrDyWtDgZgDj_m7jwDKb0 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 25c983389ecf447c9ca4bd6ca01b5a32 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-VolumesActionsTest-1436632453 Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:24:15.966472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/25c983389ecf447c9ca4bd6ca01b5a32"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-VolumesActionsTest-1436632453 Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 25c983389ecf447c9ca4bd6ca01b5a32 Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-VolumesActionsTest-1436632453 Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-VolumesActionsTest-1436632453-project Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 1b8c41cfa6854a528f43e82e0fb26220 Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-VolumesActionsTest-1436632453-project Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 337b8cef-1d31-4846-af34-178c3e57eb4d could not be found. Oct 05 20:24:15.967769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '337b8cef-1d31-4846-af34-178c3e57eb4d'} Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 337b8cef-1d31-4846-af34-178c3e57eb4d could not be found. Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:24:15.968440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 337b8cef-1d31-4846-af34-178c3e57eb4d could not be found. Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 337b8cef-1d31-4846-af34-178c3e57eb4d could not be found. Oct 05 20:24:15.969557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:15.970598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] Returning 404 to user: Instance 337b8cef-1d31-4846-af34-178c3e57eb4d could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:24:15.970598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-75fd051f-609c-43ed-b25d-9e8e1a6a9143 tempest-VolumesActionsTest-1436632453 tempest-VolumesActionsTest-1436632453-project] 10.222.0.23 "GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d" status: 404 len: 111 microversion: 2.1 time: 0.032194 Oct 05 20:24:15.970598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 197/401] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:15 2022] GET /compute/v2.1/servers/337b8cef-1d31-4846-af34-178c3e57eb4d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:24:16.298738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:16.299589 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:16.306024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:16.306515 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:16.306966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:16.307666 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:16.308123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:16.308576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:16.398679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:16.399285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:16.415878 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:16.416368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:16.416804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:16.417498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:16.418296 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:16.418724 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:16.453754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:16.461674 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fd93346e-2e3e-4798-809c-ef2152c0140f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1508 microversion: 2.1 time: 0.166916 Oct 05 20:24:16.462451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 205/402] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:16 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:16.561935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:16.571003 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:16.572477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:16.573743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-24b46f2e-e2f8-4a6f-95e0-2754b30f7a48 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.180657 Oct 05 20:24:16.574460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 198/403] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:16 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:17.486011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:17.486624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:17.493106 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:17.493656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:17.494100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:17.494786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:17.495268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:17.495693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:17.599369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:17.600001 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:17.606976 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:17.607451 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:17.607885 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:17.608573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:17.609016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:17.609431 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:17.623139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:17.632703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f14cc8de-211a-4d15-96fd-fcc8c63fb0a6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1508 microversion: 2.1 time: 0.150480 Oct 05 20:24:17.633327 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 206/404] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:17 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:17.737103 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:17.745012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:17.746473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:17.747617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-170199d4-9866-48fd-9bb6-22ba8c70b7fb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.152149 Oct 05 20:24:17.748189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 199/405] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:17 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:18.656697 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:18.657302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:18.664691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:18.665450 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:18.665911 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:18.666590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:18.667038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:18.667455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:18.772137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:18.772738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:18.779685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:18.780166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:18.780596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:18.781282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:18.781758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:18.782468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:18.801532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:18.809403 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4f8db0a0-b22d-42c8-b5cb-3b15b00cd976 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1508 microversion: 2.1 time: 0.157058 Oct 05 20:24:18.809984 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 207/406] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:18 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:18.916823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:18.919895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:18.927564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:18.929008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:18.930199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-371c4189-232e-4ed2-8d27-a4a5062b71f3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.161893 Oct 05 20:24:18.930734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 200/407] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:18 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:19.832248 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:19.832862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:19.839202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:19.839684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:19.840122 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:19.840810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:19.841974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:19.842414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:19.956924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:19.958201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:19.964519 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:19.965184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:19.965647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:19.966901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:19.967351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:19.967771 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:19.974251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:19.982050 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f8f41fd5-651e-4742-9044-04e071516e7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1508 microversion: 2.1 time: 0.153572 Oct 05 20:24:19.982613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 208/408] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:19 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:20.101304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:20.109550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:20.110994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:20.112141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b8e5a073-5e68-41dc-8b52-dfed5c2059f2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.159096 Oct 05 20:24:20.112695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 201/409] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:19 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:21.005039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:21.005669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:21.012013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:21.012489 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:21.012918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:21.014486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:21.014698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:21.015114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:21.139878 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:21.142560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:21.152679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:21.153840 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:21.154974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:21.156370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:21.157696 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:21.158321 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:21.165468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:21.176562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3cf54d8f-0265-44c4-8929-5a6184d92f7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1508 microversion: 2.1 time: 0.175219 Oct 05 20:24:21.178099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 209/410] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:21 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:21.311316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:21.320492 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:21.322437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:21.323809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8ac1f9f4-2726-4e78-856b-c8ecdf5685ce tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.189862 Oct 05 20:24:21.324588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 202/411] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:21 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:22.202267 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:22.203628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:22.212666 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:22.213497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:22.214283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:22.215280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:22.215880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:22.216448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:22.353280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:22.359028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:22.385965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:22.388421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:22.389698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:22.394915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:22.398453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:22.399201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:22.517035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:22.526867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-acb3880b-ae91-4566-86a2-a29db957cd7b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1514 microversion: 2.1 time: 0.328954 Oct 05 20:24:22.532958 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 210/412] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:22 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1514 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:22.676239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:22.691301 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:22.694215 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:22.696165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-53b7acea-fcb1-4f5c-b51b-046416f64609 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.351148 Oct 05 20:24:22.697078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 203/413] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:22 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:23.724650 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:23.725665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:23.733342 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:23.734331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:23.734976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:23.735962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:23.736669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:23.737276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:23.942886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:23.952500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:23.954092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:23.955539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4d16a96c-b2dd-4149-96ee-4a525beacad0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.235245 Oct 05 20:24:23.970400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 211/414] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:23 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:24.108930 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-01201f83-c264-4285-9e4e-c346f819c9d5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'create', calling method: .version_select at 0x7f3e0271adc0>, body: {"keypair": {"name": "tempest-keypair-1061647176", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3cCShU51bd9uK7y7Jt1xi3OUSrRpd+RPd6VpJJY3KmFbbo6ykBUZjpgjFqO0i0lbI2B4kRCsvPcCFsUYSv8hvoQKTGerzhYh7R+a8iUfKPC+QXEP2OEg8Vb0HwXjQmEA=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:24.141461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-01201f83-c264-4285-9e4e-c346f819c9d5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for project 07f868da50254a68bc692bca433d2699. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:24:24.146545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-01201f83-c264-4285-9e4e-c346f819c9d5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for user 1301a78c1a684c94acb9f26b56f39f21 and project 07f868da50254a68bc692bca433d2699. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:24:24.179758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-01201f83-c264-4285-9e4e-c346f819c9d5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077455 Oct 05 20:24:24.181244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 204/415] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:24:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:24.983181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:24.983831 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:24.991921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=76 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:24.993570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:24.994354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:24.994948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:24.996060 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:24.996769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:24.997646 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:25.153018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:25.162969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:25.165242 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:25.166800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4eec7a40-053b-4a26-80bf-27ea36a0b23b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.188238 Oct 05 20:24:25.167574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 212/416] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:24 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:25.719706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-902989452", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cc456dbc-ea96-4537-b89e-3b9562b74ec1"}], "security_groups": [{"name": "tempest-securitygroup--1698941291"}], "key_name": "tempest-keypair-1061647176", "user_data": "}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:25.839760 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] validate_networks() for [('cc456dbc-ea96-4537-b89e-3b9562b74ec1', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:24:26.198434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:26.200277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:26.214597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:26.216296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:26.217048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:26.218027 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:26.218566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:26.219071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:26.275879 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:24:26.276325 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:24:26.277760 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:24:26.278371 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:24:26.278971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:24:26.299316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:26.300041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:26.300803 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:26.301901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:26.303421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:26.304197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:26.328789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for project 07f868da50254a68bc692bca433d2699. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:24:26.333272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Getting quotas for user 1301a78c1a684c94acb9f26b56f39f21 and project 07f868da50254a68bc692bca433d2699. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:24:26.348055 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:24:26.350495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:24:26.402066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:26.410888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:26.412621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:26.414401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3c5e2496-9a29-46d3-ad5c-7d9ded196df3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.699322 Oct 05 20:24:26.415155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ddbec43d-096b-4662-943b-a8a88a7f6e95 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.222459 Oct 05 20:24:26.415364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 205/417] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:24:25 2022] POST /compute/v2.1/servers => generated 409 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:24:26.417066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 213/418] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:26 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:26.442591 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-08a37f9c-0fad-469a-b891-ba20657774a5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:26.443397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-08a37f9c-0fad-469a-b891-ba20657774a5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:26.511300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-08a37f9c-0fad-469a-b891-ba20657774a5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:26.519312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-08a37f9c-0fad-469a-b891-ba20657774a5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1245 microversion: 2.1 time: 0.086756 Oct 05 20:24:26.519890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 206/419] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:26 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:27.452183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:27.452833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:27.467085 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:27.467708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:27.468267 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:27.480958 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:27.481827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:27.483252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:27.543194 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:27.546705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:27.579367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:27.580746 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:27.581730 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:27.584438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:27.585255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:27.586323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:27.684506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:27.689504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:27.696874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:27.698221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0f7bf0f6-8886-4083-8e09-60ecf32ce50b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1297 microversion: 2.1 time: 0.160271 Oct 05 20:24:27.698812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:27.699365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 207/420] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:27 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1297 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:27.700423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5cc07dda-e551-467b-ac8f-94e5b759c55c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.254940 Oct 05 20:24:27.725873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 214/421] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:27 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:28.730993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:28.731982 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:28.732907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:28.733690 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:28.739599 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:28.740170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:28.740693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:28.741188 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:28.741742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:28.742095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:28.742539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:28.742858 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:28.743754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:28.744349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:28.745026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:28.745831 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:28.835513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:28.849003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-cfe970af-ee89-4c74-98a1-c416bab293ab tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1297 microversion: 2.1 time: 0.121565 Oct 05 20:24:28.850340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 215/422] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:28 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:28.903814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:28.913807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:28.915592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:28.916918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-df16fbc5-87f8-4339-8afb-ded3d48b2069 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.189731 Oct 05 20:24:28.917524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 208/423] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:28 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:29.872400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:29.874194 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:29.883622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:29.884317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:29.884916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:29.885997 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:29.886601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:29.887179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:29.942911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:29.944184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:29.951815 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:29.952642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:29.953181 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:29.954475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:29.955166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:29.955299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:29.956050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:29.965495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-34646c44-2a68-47e5-b766-896815c84980 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1297 microversion: 2.1 time: 0.096963 Oct 05 20:24:29.966393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 216/424] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:29 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:30.106587 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:30.116681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:30.118606 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:30.119790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4381e67f-249f-4a1c-a98c-644f8601fa07 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.181076 Oct 05 20:24:30.120573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 209/425] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:29 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:30.989837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:30.991076 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:30.997797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:30.998511 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:30.998940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:30.999810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:31.000268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:31.000690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:31.070593 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:31.081531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-58ab40ef-71e5-4656-8c24-49e1a85caf31 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1297 microversion: 2.1 time: 0.094617 Oct 05 20:24:31.093818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 217/426] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:30 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:31.145468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:31.146791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:31.155533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:31.156541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:31.157163 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:31.158772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:31.159433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:31.159865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:31.338660 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:31.347969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:31.349409 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:31.361007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e3afadba-d58b-41f7-959b-d8eb414838a9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.209154 Oct 05 20:24:31.361007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 210/427] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:31 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:32.104910 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:32.110477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:32.126505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:32.130518 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:32.131846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:32.138471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:32.138471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:32.138471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:32.217374 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:32.226414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e7cfd312-40ee-43d8-be10-74af3bed3793 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1315 microversion: 2.1 time: 0.125300 Oct 05 20:24:32.227222 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 218/428] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:32 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1315 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:32.379073 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:32.379659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:32.386549 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:32.388045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:32.405779 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:32.410671 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:32.411461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:32.415584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:32.587619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:32.596778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:32.598783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:32.600219 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-10c00fdd-d093-45c2-867a-2edb65c4a4f7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1744 microversion: 2.20 time: 0.225201 Oct 05 20:24:32.600963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 211/429] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:32 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1744 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:33.250514 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:33.251123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:33.257908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:33.258726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:33.259414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:33.260201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:33.260752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:33.261256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:33.342158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:33.345780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:33.353120 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2ef7842c-3215-4cfb-b611-4a0eb014ae2a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1303 microversion: 2.1 time: 0.106588 Oct 05 20:24:33.354218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 219/430] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:33 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:33.629938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:33.631537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:33.639706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:33.640529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:33.641196 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:33.642184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:33.642753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:33.643306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:33.998565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:34.007095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:34.008550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:34.009738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-37a0543c-683d-4b8b-8456-8fac0ef42173 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1744 microversion: 2.20 time: 0.384301 Oct 05 20:24:34.021738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 212/431] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:33 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1744 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:34.380455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:34.381091 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:34.389333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:34.389857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:34.390304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:34.391021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:34.391504 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:34.391931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:34.474255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:34.482030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-60bd443a-1e4a-4885-9350-562e676a69a3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1303 microversion: 2.1 time: 0.106019 Oct 05 20:24:34.482596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 220/432] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:34 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1303 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:35.035817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:35.036434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:35.046890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:35.047428 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:35.047845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:35.048639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:35.049138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:35.049452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:35.308601 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:35.320508 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:35.321969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:35.323356 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a5f96eb8-bee5-4b11-9443-56c674e5b649 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1744 microversion: 2.20 time: 0.291324 Oct 05 20:24:35.323975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 213/433] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:35 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1744 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:35.511380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:35.511988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:35.519127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:35.519797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:35.520246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:35.520934 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:35.521379 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:35.521814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:35.592274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:35.603289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dede59a0-087c-4d62-9c7e-fca494a1852d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1303 microversion: 2.1 time: 0.097489 Oct 05 20:24:35.604475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 221/434] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:35 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:36.256741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6f7114cc-6e63-45d1-9dfd-49e2a823e155 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:36.267061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f7114cc-6e63-45d1-9dfd-49e2a823e155 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.267601 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f7114cc-6e63-45d1-9dfd-49e2a823e155 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.269305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6f7114cc-6e63-45d1-9dfd-49e2a823e155 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:36.351405 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:36.352637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:36.353226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:36.362349 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.363395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.364064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:36.365064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.365991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.367336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:36.434155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6f7114cc-6e63-45d1-9dfd-49e2a823e155 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Going to try to stop instance {{(pid=120350) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 20:24:36.494115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6f7114cc-6e63-45d1-9dfd-49e2a823e155 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action" status: 202 len: 0 microversion: 2.1 time: 0.243371 Oct 05 20:24:36.495180 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 214/435] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:24:36 2022] POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:24:36.517968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:36.520870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:36.530204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=12 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:36.532473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.532878 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.533442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:36.534404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.534998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.537056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:36.817914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:36.831801 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7f867b09-8bc6-41ad-8eab-9ece98c23156 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.331440 Oct 05 20:24:36.834451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:36.844877 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:36.845021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 215/436] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:36 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:36.846697 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:36.848087 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-17638f56-7b3d-4b79-bee8-409b33d4daea tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1744 microversion: 2.20 time: 0.501987 Oct 05 20:24:36.849617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 222/437] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:36 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1744 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:36.852625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:36.853239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:36.859929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.861418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.887331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:36.888956 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:36.889786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:36.890298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:37.126638 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:37.143147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-973cbbf9-bc21-4a48-b6a3-d6e06a359f1a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.296967 Oct 05 20:24:37.144081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 216/438] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:36 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:37.895230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:37.895870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:37.897204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:37.897934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:37.901665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:37.912221 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:37.912753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:37.914462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:37.915142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:37.915672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:37.916228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:37.916607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:37.917112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:37.918883 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:37.924121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:37.924891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:37.925608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:38.184509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:38.197217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:38.208764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:38.210025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dc3a1b0e-645e-4cd0-b265-8fe9b615b895 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.320801 Oct 05 20:24:38.221626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 217/439] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:37 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:38.221626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:38.231514 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:38.235389 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:38.235892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:38.236330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:38.241337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:38.241853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:38.242287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:38.485213 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:38.510693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-82b445e4-21ae-448e-b822-38c9f945a817 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.646565 Oct 05 20:24:38.527420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 223/440] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:37 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:38.533135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:38.538732 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-1632aa72-45c0-46a3-83b9-476e16b06cc8 req-881645b9-fa85-44ef-a3cb-75b87cf0e41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "name": "network-vif-plugged", "status": "completed", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:38.545013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5c16062c-93e9-4854-9743-4a3676955d05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.332479 Oct 05 20:24:38.545897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 218/441] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:38 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:38.567241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-29dc3ef7-ba03-4a00-acb6-d447a91ab6d2 req-b285eef9-540d-4386-91e2-ca64c3b54fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200392c4-aaf6-477e-a61a-45cf68f9b765", "tag": "1c54cda3-3ed7-4392-b95f-fb3527c84492"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:38.576459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1632aa72-45c0-46a3-83b9-476e16b06cc8 req-881645b9-fa85-44ef-a3cb-75b87cf0e41b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:38.577214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1632aa72-45c0-46a3-83b9-476e16b06cc8 req-881645b9-fa85-44ef-a3cb-75b87cf0e41b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:38.577815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1632aa72-45c0-46a3-83b9-476e16b06cc8 req-881645b9-fa85-44ef-a3cb-75b87cf0e41b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:38.583711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-29dc3ef7-ba03-4a00-acb6-d447a91ab6d2 req-b285eef9-540d-4386-91e2-ca64c3b54fc3 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:38.584201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-29dc3ef7-ba03-4a00-acb6-d447a91ab6d2 req-b285eef9-540d-4386-91e2-ca64c3b54fc3 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:38.584628 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-29dc3ef7-ba03-4a00-acb6-d447a91ab6d2 req-b285eef9-540d-4386-91e2-ca64c3b54fc3 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:38.597595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:38.599886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-1632aa72-45c0-46a3-83b9-476e16b06cc8 req-881645b9-fa85-44ef-a3cb-75b87cf0e41b service nova] Creating event network-vif-plugged:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:24:38.614823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-1632aa72-45c0-46a3-83b9-476e16b06cc8 req-881645b9-fa85-44ef-a3cb-75b87cf0e41b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085873 Oct 05 20:24:38.615619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 224/442] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:38.620714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-29dc3ef7-ba03-4a00-acb6-d447a91ab6d2 req-b285eef9-540d-4386-91e2-ca64c3b54fc3 service nova] Creating event network-changed:1c54cda3-3ed7-4392-b95f-fb3527c84492 for instance 200392c4-aaf6-477e-a61a-45cf68f9b765 on hv-cinder-80152 Oct 05 20:24:38.639147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-29dc3ef7-ba03-4a00-acb6-d447a91ab6d2 req-b285eef9-540d-4386-91e2-ca64c3b54fc3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082729 Oct 05 20:24:38.639941 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 219/443] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:39.243334 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:39.245652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:39.253499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:39.254297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:39.254895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:39.255841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:39.256721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:39.257292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:39.448591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:39.463209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:39.465133 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:39.468154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b79604fc-54c3-48df-985c-760e25f1f01d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.230961 Oct 05 20:24:39.486763 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 225/444] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:39 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:39.541024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:39.541490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:39.553152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:39.553895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:39.554511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:39.555397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:39.555845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:39.556604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:39.587643 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:39.588366 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:39.595033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:39.595704 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:39.596301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:39.597147 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:39.597767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:39.598489 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:39.726313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:39.741181 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5166be63-501a-43c2-b26c-39f379260703 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.204972 Oct 05 20:24:39.742076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 220/445] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:39 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:39.782482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:39.792845 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5000892b-7af0-41f5-806a-0c722a488ad1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.221973 Oct 05 20:24:39.795029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 226/446] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:39 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:40.496458 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:40.497162 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:40.503857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:40.504337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:40.504795 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:40.505489 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:40.505984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:40.506409 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:40.661087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:40.672775 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:40.675710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:40.677543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7e18c966-20b9-476d-a15b-7bcb8b6107cb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.185066 Oct 05 20:24:40.678328 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 221/447] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:40 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:40.765880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:40.766483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:40.788333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:40.788840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:40.789277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:40.790005 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:40.790973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:40.791399 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:40.821205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:40.823127 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:40.838173 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:40.838676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:40.839114 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:40.850595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:40.851092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:40.851543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:41.045888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:41.064890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e61a3e3b-2c76-4049-97df-d17fd96c0e92 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.248232 Oct 05 20:24:41.066436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 222/448] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:40 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:41.095171 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:41.095677 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:41.096655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:41.103067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:41.103912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:41.104622 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:41.105393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:41.105901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:41.106334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:41.153100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b62e6798-594e-4dcb-9371-13d3f7ec3054 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.390799 Oct 05 20:24:41.166597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 227/449] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:40 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:41.339837 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lazy-loading 'services' on Instance uuid 52c5126d-2b2b-4cc9-a187-511c93edaa78 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:24:41.521366 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-68de86f3-3760-474b-8c3c-f06c857ff32d tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78/os-volume_attachments/34a8e199-2af3-493e-89e0-5a75475a08d3" status: 202 len: 0 microversion: 2.1 time: 0.453106 Oct 05 20:24:41.522599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 223/450] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:24:41 2022] DELETE /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78/os-volume_attachments/34a8e199-2af3-493e-89e0-5a75475a08d3 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:24:41.703900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:41.704626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:41.711434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:41.712236 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:41.712876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:41.713797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:41.714439 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:41.715069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:41.900836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:41.910277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:41.911873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:41.913427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a668f22c-2a07-4674-94e8-3cd97872cc9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.214199 Oct 05 20:24:41.914509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 228/451] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:41 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:42.094324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:42.095690 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:42.103325 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:42.104156 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:42.104815 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:42.105742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:42.106560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:42.107415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:42.178557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:42.179519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:42.189196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:42.189981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:42.192981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:42.193744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:42.194271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:42.194705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:42.302714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:42.312174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3f1b2faa-9852-44db-a7ef-fa29cd0f5770 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.221971 Oct 05 20:24:42.325945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 224/452] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:42 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:42.352606 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:42.362134 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8dae77f8-0840-4a90-ac00-0629761aba9b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.187467 Oct 05 20:24:42.374940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 229/453] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:42 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:42.944200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:42.945273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:42.952976 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:42.953799 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:42.954501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:42.955461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:42.956150 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:42.956756 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.168044 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:43.184026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:43.188861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:43.190212 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3f8a2f23-d9ce-4df8-a699-4363f517f66d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.253406 Oct 05 20:24:43.191012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 225/454] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:42 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:43.334463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:43.335817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:43.347792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.349161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.349929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.350926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.352116 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.387206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:43.389742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:43.399876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.405024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.405024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.405932 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.410121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.410675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.563144 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:43.571669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-808b49f2-1129-4c10-9cdb-1d57ad120972 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.240900 Oct 05 20:24:43.574046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 230/455] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:43 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:43.622004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:43.630584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-07e69b96-8e27-499f-a521-d9bc7ac454e7 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.247958 Oct 05 20:24:43.646117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 226/456] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:43 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:43.773967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:43.774613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:43.782045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.782687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.783370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.784449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.785778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.787074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.823680 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:24:43.956677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b5c1cfae-e53c-42f3-916b-e2029e43b355 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 204 len: 0 microversion: 2.1 time: 0.186191 Oct 05 20:24:43.957956 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 231/457] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:24:43 2022] DELETE /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:24:43.967685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:43.968762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:43.977935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.978425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.978853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:43.979726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:43.980454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:43.981026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.195989 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:44.207383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-74e38718-f9d6-4289-b092-ff90b9da15ed tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1513 microversion: 2.1 time: 0.245525 Oct 05 20:24:44.225320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 227/458] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:43 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1513 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:44.230501 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:44.231198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:44.241109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:44.241248 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:44.242240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.243134 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:44.244234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:44.244808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.475779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:44.486381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:44.489102 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:44.490570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6f8540c8-6a61-4755-9e82-668cba1b9113 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.264379 Oct 05 20:24:44.491334 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 232/459] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:44 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:44.596278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:44.597205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:44.603999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:44.604655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:44.605201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.606071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:44.607316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:44.607824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.670333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:44.671750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:44.678704 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:44.679527 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:44.680336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.681309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:44.682004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:44.682622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:44.819439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:44.828375 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ec4882e3-8793-4219-9a9f-4e3f2c280ee5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.236323 Oct 05 20:24:44.843370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 228/460] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:44 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:44.926044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:44.935797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-04506992-9dae-4866-854c-0688c21cbc51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.275170 Oct 05 20:24:44.937600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 233/461] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:44 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:45.231628 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:45.232930 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:45.240310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.241087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.241621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.242531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.243201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.243810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.413333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:45.422651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f87d6f8f-e92a-4a89-81cb-ddd534ef6550 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1513 microversion: 2.1 time: 0.194783 Oct 05 20:24:45.423927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 229/462] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:45 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:45.520910 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:45.522609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:45.530403 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.531225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.531858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.532755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.533391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.534016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.735858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:45.750136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:45.751607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:45.752976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2ce31a72-ed08-4e36-ac3c-ab77acb851f1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.236134 Oct 05 20:24:45.774251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 234/463] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:45 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:45.854587 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:45.855227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:45.876270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.877143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.879275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.880269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.880964 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.881670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.963783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:45.965674 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:45.979895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.988259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.991827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:45.992621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:45.993093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:45.993767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:46.038424 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:46.201631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:46.218463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5829e1a2-6604-4e09-a86e-ebd337f81f3b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.367549 Oct 05 20:24:46.220139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 230/464] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:45 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:46.288730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:46.299117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-eddf4227-d4d9-424b-be25-9fb0d8908b91 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.342768 Oct 05 20:24:46.302349 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 235/465] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:45 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:46.344482 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-2e3f17f3-934a-43f3-81a5-d5cdf7c0ba54 req-730510da-c69c-4390-8df7-6d19dae3df63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200392c4-aaf6-477e-a61a-45cf68f9b765", "name": "network-vif-plugged", "status": "completed", "tag": "1c54cda3-3ed7-4392-b95f-fb3527c84492"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:46.361026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-2e3f17f3-934a-43f3-81a5-d5cdf7c0ba54 req-730510da-c69c-4390-8df7-6d19dae3df63 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:46.373590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-2e3f17f3-934a-43f3-81a5-d5cdf7c0ba54 req-730510da-c69c-4390-8df7-6d19dae3df63 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:46.374324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-2e3f17f3-934a-43f3-81a5-d5cdf7c0ba54 req-730510da-c69c-4390-8df7-6d19dae3df63 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:46.387661 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-2e3f17f3-934a-43f3-81a5-d5cdf7c0ba54 req-730510da-c69c-4390-8df7-6d19dae3df63 service nova] Creating event network-vif-plugged:1c54cda3-3ed7-4392-b95f-fb3527c84492 for instance 200392c4-aaf6-477e-a61a-45cf68f9b765 on hv-cinder-80152 Oct 05 20:24:46.393243 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-2e3f17f3-934a-43f3-81a5-d5cdf7c0ba54 req-730510da-c69c-4390-8df7-6d19dae3df63 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052999 Oct 05 20:24:46.394483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 231/466] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:46.452645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:46.457143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:46.479114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:46.479888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:46.480498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:46.485261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:46.486061 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:46.486849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:46.783422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:46.784556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:46.787210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:46.794048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:46.794969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:46.795514 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:46.796440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:46.797133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:46.797813 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:46.806137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1de55f3e-b384-4c6f-b1b4-2e807edf5b46 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1513 microversion: 2.1 time: 0.357150 Oct 05 20:24:46.807079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 236/467] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:46 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1513 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:46.982454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:46.999377 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:47.003728 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:47.004942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a768a7a8-c700-48dd-ad67-5a272c0147ee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.226569 Oct 05 20:24:47.006068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 232/468] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:46 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:47.029765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-f0c9f665-a033-4639-bd84-1f1ff5b12617 req-4ba95cf7-d3f1-45e3-ba4b-8631010b06fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52c5126d-2b2b-4cc9-a187-511c93edaa78", "name": "network-vif-deleted", "tag": "ab41397f-21da-4863-a97b-9e600a47ad52"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:47.040661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f0c9f665-a033-4639-bd84-1f1ff5b12617 req-4ba95cf7-d3f1-45e3-ba4b-8631010b06fc service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.041483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f0c9f665-a033-4639-bd84-1f1ff5b12617 req-4ba95cf7-d3f1-45e3-ba4b-8631010b06fc service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.042015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-f0c9f665-a033-4639-bd84-1f1ff5b12617 req-4ba95cf7-d3f1-45e3-ba4b-8631010b06fc service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.054123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-f0c9f665-a033-4639-bd84-1f1ff5b12617 req-4ba95cf7-d3f1-45e3-ba4b-8631010b06fc service nova] Creating event network-vif-deleted:ab41397f-21da-4863-a97b-9e600a47ad52 for instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 on hv-cinder-80152 Oct 05 20:24:47.062858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-f0c9f665-a033-4639-bd84-1f1ff5b12617 req-4ba95cf7-d3f1-45e3-ba4b-8631010b06fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037053 Oct 05 20:24:47.064359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 237/469] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:47.243970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:47.244686 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:47.251381 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.252350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.253911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.254888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.255658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.256321 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.329153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:47.330021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:47.340669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.342847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.345605 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.346522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.347330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.350088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.466631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:47.475874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-04267d57-24e9-4dfe-9e12-9e317c200e9f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1371 microversion: 2.1 time: 0.236217 Oct 05 20:24:47.477682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 233/470] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:47 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:47.637045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:47.649021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f49bd562-3377-4181-9827-3a8c8c111e34 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.324964 Oct 05 20:24:47.654513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 238/471] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:47 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:47.833414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:47.834435 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:47.840701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.846159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.848393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.849413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:47.850117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:47.850784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:47.925762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:47.934997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d24e8d1d-9581-46b6-b007-4f06a0e46e02 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1303 microversion: 2.1 time: 0.107048 Oct 05 20:24:47.935940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 234/472] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:47 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:48.031841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:48.032454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:48.047239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.049006 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.049550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.050385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.050950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.051454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.210329 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:48.222368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:48.223834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:48.225603 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ebf68cb9-937c-4be7-bd49-14cfe84e42a4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.198338 Oct 05 20:24:48.226887 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 239/473] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:48 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:48.501203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:48.501776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:48.508542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.509114 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.509710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.510469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.514009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.514656 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.676220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:48.676878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:48.687362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:48.691830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.692583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.693564 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.694469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.694918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.695589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c1f42810-e4b3-434c-8ff9-a620bf686986 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1563 microversion: 2.1 time: 0.199070 Oct 05 20:24:48.698245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.698669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 235/474] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:48 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1563 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:48.724899 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:48.725676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:48.733902 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.734629 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.735241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.736318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.737424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.738160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.762356 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:48.852926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-894926f7-514f-4469-a2a0-b082c4a016d4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131972 Oct 05 20:24:48.854158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 236/475] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:24:48 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:24:48.924526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:48.936634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e8019b16-4382-42af-9f51-29ab2b23c208 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.264214 Oct 05 20:24:48.938610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 240/476] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:48 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:48.958893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:48.959577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:48.965845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.966406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.966959 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:48.967884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:48.968519 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:48.969097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.055224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:49.055715 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:49.056274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.056751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lazy-loading 'fault' on Instance uuid 52c5126d-2b2b-4cc9-a187-511c93edaa78 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:24:49.125079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:49.141374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9ac1e895-d768-426b-b32c-c149ab9a04be tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 200 len: 1308 microversion: 2.1 time: 0.186201 Oct 05 20:24:49.145568 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 237/477] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:48 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:49.254039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:49.254703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:49.263063 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:49.263559 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:49.263998 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.264700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:49.265155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:49.265603 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.402083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:49.410189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:49.411662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:49.412824 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ba5694f4-ad57-4837-9ac3-0ef5f10a37d4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1739 microversion: 2.20 time: 0.163378 Oct 05 20:24:49.413385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 241/478] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:49 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:49.957534 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-4f415beb-cf99-4145-abc6-afa6b81c56ec req-9c86dd45-6192-446d-bbac-68b911e317e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200392c4-aaf6-477e-a61a-45cf68f9b765", "tag": "1c54cda3-3ed7-4392-b95f-fb3527c84492"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:49.959892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:49.960554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:49.967120 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:49.967804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:49.968404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.969245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:49.969363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4f415beb-cf99-4145-abc6-afa6b81c56ec req-9c86dd45-6192-446d-bbac-68b911e317e8 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:49.969857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4f415beb-cf99-4145-abc6-afa6b81c56ec req-9c86dd45-6192-446d-bbac-68b911e317e8 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:49.970182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:49.970297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4f415beb-cf99-4145-abc6-afa6b81c56ec req-9c86dd45-6192-446d-bbac-68b911e317e8 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.970855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:49.984248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-4f415beb-cf99-4145-abc6-afa6b81c56ec req-9c86dd45-6192-446d-bbac-68b911e317e8 service nova] Creating event network-changed:1c54cda3-3ed7-4392-b95f-fb3527c84492 for instance 200392c4-aaf6-477e-a61a-45cf68f9b765 on hv-cinder-80152 Oct 05 20:24:49.990820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-4f415beb-cf99-4145-abc6-afa6b81c56ec req-9c86dd45-6192-446d-bbac-68b911e317e8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037117 Oct 05 20:24:49.991661 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 238/479] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:24:50.109730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:50.118243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fa29b0ee-d686-46a2-b255-076adc154e70 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.162071 Oct 05 20:24:50.118814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 242/480] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:49 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:50.166721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:50.167353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 52c5126d-2b2b-4cc9-a187-511c93edaa78] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:50.174055 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:50.174532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:50.174962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:50.175646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:50.176093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:50.176512 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:50.189973 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] HTTP exception thrown: Instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 could not be found. Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Request method failure captured: Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 HTTP/1.1 Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPeenhZlvaPhWKob56bVKopUTmCLsnHEkzg4pKoKsZ8ojDyyij6tGQmp1oBIAYZWIbDrcivtsWMHCdkdTWjrcwpcL7P9N7GjX3VEW2pB5dVld0epRE8J3-od8JuBDHtAquczaWtUgaD2Hg7xKS8Q0PIX1gQFvA-cLT5YJokrd1sX35UM Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 1c2141e33c264250aa7642f46a9b4048 Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1842876056 Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:24:50.191592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-VolumesSnapshotTestJSON-1842876056 Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 1c2141e33c264250aa7642f46a9b4048 Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1842876056 Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-VolumesSnapshotTestJSON-1842876056-project Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 776c647ef6d34d989ac12d4e91cc62ab Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-VolumesSnapshotTestJSON-1842876056-project Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 could not be found. Oct 05 20:24:50.193410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '52c5126d-2b2b-4cc9-a187-511c93edaa78'} Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 could not be found. Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:24:50.197415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 could not be found. Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 could not be found. Oct 05 20:24:50.198914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:24:50.200820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Returning 404 to user: Instance 52c5126d-2b2b-4cc9-a187-511c93edaa78 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:24:50.200820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-213b2533-31df-441f-81e3-11d3b9d0b126 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78" status: 404 len: 111 microversion: 2.1 time: 0.030799 Oct 05 20:24:50.200820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 239/481] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:50 2022] GET /compute/v2.1/servers/52c5126d-2b2b-4cc9-a187-511c93edaa78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:24:50.452886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:50.459957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:50.473823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:50.475128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:50.475609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:50.476338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:50.480246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:50.480701 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:50.740745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:50.752418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:50.753874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:50.755546 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-342afc37-18cf-4933-ad1c-c465284a763b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1721 microversion: 2.20 time: 0.312597 Oct 05 20:24:50.756689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 243/482] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:50 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:51.143197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:51.143835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:51.150248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:51.150750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:51.151073 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:51.151777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:51.152248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:51.152636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:51.299486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:51.308619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a011964f-f8c7-46af-9f82-c4f70844f37c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.169812 Oct 05 20:24:51.310071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 240/483] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:51 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:51.783072 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:51.783686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:51.790576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:51.791071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:51.791506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:51.792227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:51.792682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:51.793102 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:51.926545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:51.935440 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:51.936888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:51.938071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-31ca4621-e8dd-4173-b9e4-15ea5911aced tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1721 microversion: 2.20 time: 0.159543 Oct 05 20:24:51.938639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 244/484] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:51 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:52.334951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:52.336265 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:52.344473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:52.344687 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:52.345121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:52.345836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:52.346289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:52.346706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:52.480921 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:52.489352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-da7d1adc-67e1-4485-a987-1f1205968ea9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.159833 Oct 05 20:24:52.490369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 241/485] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:52 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:52.963187 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:52.963787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:52.970302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:52.970774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:52.971199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:52.971878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:52.972324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:52.972733 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:53.107698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:53.115836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:53.117269 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:53.118460 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3c91fd2f-18c2-498c-8998-f9fba566c7bb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1721 microversion: 2.20 time: 0.159069 Oct 05 20:24:53.119038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 245/486] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:52 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:53.516654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:53.517267 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:53.524126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:53.524699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:53.525109 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:53.525751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:53.526201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:53.526621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:53.756405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:53.764734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3466a8e1-3369-4ad5-ada0-2ac34219e68d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.252410 Oct 05 20:24:53.782307 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 242/487] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:53 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:54.131335 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-4a9efdcd-791e-4063-a3ef-110c5412be0b req-d98182a5-8c38-4abb-8ba1-48f59c159844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "name": "network-vif-unplugged", "status": "completed", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:54.143551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-4a9efdcd-791e-4063-a3ef-110c5412be0b req-d98182a5-8c38-4abb-8ba1-48f59c159844 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:54.144225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-4a9efdcd-791e-4063-a3ef-110c5412be0b req-d98182a5-8c38-4abb-8ba1-48f59c159844 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:54.144658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-4a9efdcd-791e-4063-a3ef-110c5412be0b req-d98182a5-8c38-4abb-8ba1-48f59c159844 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:54.146119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:54.146729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:54.156163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-4a9efdcd-791e-4063-a3ef-110c5412be0b req-d98182a5-8c38-4abb-8ba1-48f59c159844 service nova] Creating event network-vif-unplugged:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:24:54.156789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:54.157275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:54.160490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:54.161269 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-4a9efdcd-791e-4063-a3ef-110c5412be0b req-d98182a5-8c38-4abb-8ba1-48f59c159844 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033561 Oct 05 20:24:54.162192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 246/488] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:24:54.163131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:54.163607 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:54.164042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:54.301809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:54.310667 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:54.312121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:54.313281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-15fd2fff-d5c9-4a37-8a6c-a54093d0a879 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1721 microversion: 2.20 time: 0.172047 Oct 05 20:24:54.313874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 243/489] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:54 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:54.789917 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:54.790625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:54.797255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:54.797799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:54.798233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:54.798921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:54.799375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:54.799796 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:54.933941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:54.942482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b7a63534-12e7-4412-b0b1-58fbf3c95bb6 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.156500 Oct 05 20:24:54.943049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 247/490] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:54 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:55.338962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:55.340339 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:55.347915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:55.348481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:55.349028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:55.349818 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:55.350264 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:55.350683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:55.480927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:55.489238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:55.490708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:55.491883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-87f4a854-fd0d-4c89-ae9b-e5592342da16 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1721 microversion: 2.20 time: 0.156820 Oct 05 20:24:55.492456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 244/491] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:55 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:55.967358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:55.968106 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:55.975375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:55.978826 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:55.979421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:55.979742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:55.980434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:55.980914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:55.981986 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:56.115265 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:56.123620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f6103014-7d47-46b2-8f27-df28dae50fc1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.161088 Oct 05 20:24:56.124179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 248/492] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:55 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:56.518346 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:56.518961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:56.525210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:56.525730 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:56.526170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:56.526997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:56.527811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:56.528096 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:56.669504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:56.677430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:56.678953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:56.680120 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f9248151-b864-464e-a377-f8638ebd04f5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1724 microversion: 2.20 time: 0.165993 Oct 05 20:24:56.680842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 245/493] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:56 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:56.705869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b3ca04-3ee9-442f-8f9f-59f8f894b3c6"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:56.708209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:56.714189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:56.714667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:56.715130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:56.716473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:56.716930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:56.717381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.018323 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b349502c-5161-430f-b64a-f20692ebfd6d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.316742 Oct 05 20:24:57.019600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 249/494] 10.222.0.23 () {62 vars in 1364 bytes} [Wed Oct 5 20:24:56 2022] POST /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments => generated 188 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 20:24:57.147086 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:57.147883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:57.154333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:57.154574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:57.154961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:57.155079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:57.155544 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.156327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:57.156997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:57.157488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.161419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:57.161949 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:57.163815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.163815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:57.163815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:57.164144 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.218502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120351) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 20:24:57.245458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:24:57.299608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c84d6e3b-f015-4434-99b7-32e563972e9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/action" status: 202 len: 0 microversion: 2.20 time: 0.148907 Oct 05 20:24:57.300573 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 250/495] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Oct 5 20:24:57 2022] POST /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:24:57.312114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:57.312877 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:57.315388 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:57.320598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:57.321336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:57.322050 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.322916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:57.323562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:57.324058 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:57.326801 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4a997a09-c93c-4e2e-bb1a-525bdeebcda2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.183669 Oct 05 20:24:57.333550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 246/496] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:57 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:57.465303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:57.474458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:57.475885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:57.477029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1a0286d5-8674-491b-af23-dbcb317a9ea8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1810 microversion: 2.20 time: 0.170666 Oct 05 20:24:57.477628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 251/497] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:57 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:58.355648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:58.356894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:58.366757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:58.366757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:58.366757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:58.366757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:58.367589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:58.367589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:58.494465 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:58.502473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:58.502953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-79918b70-1458-4526-bef2-526caafbb348 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.150847 Oct 05 20:24:58.503202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:58.503354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 247/498] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:58 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:24:58.509802 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:58.510282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:58.510710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:58.511388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:58.511834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:58.512252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:58.644250 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:58.652795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:58.654261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:58.655420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d2939be4-e75b-4706-b17a-7e4bd010cf6c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1810 microversion: 2.20 time: 0.156748 Oct 05 20:24:58.655978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 252/499] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:58 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:24:59.164233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-835646241", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "networks": [{"uuid": "8161c64b-ad1b-4220-99b9-84126ab53e0a"}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:24:59.221925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] validate_networks() for [('8161c64b-ad1b-4220-99b9-84126ab53e0a', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:24:59.525715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:59.526317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:59.534671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:59.535174 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:59.535800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:59.536760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:59.537125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:59.537620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:59.673055 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:59.682481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9716782c-ef7f-4ac9-902c-0772abe0501f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.160507 Oct 05 20:24:59.683662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 253/500] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:59 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:24:59.688679 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:59.689285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:24:59.695530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:59.696011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:59.696609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:59.697461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:59.698088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:59.698513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:59.836201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:24:59.837332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:24:59.838274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:24:59.838782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:24:59.839291 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:24:59.840202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:59.849431 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:59.849684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:59.850313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:59.850971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:59.851466 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:24:59.852286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:24:59.852725 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f7c8a02d-3e7a-46ee-831f-7eb06dab1205 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1752 microversion: 2.20 time: 0.167989 Oct 05 20:24:59.853160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:24:59.853623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 254/501] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:24:59 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:24:59.866448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:24:59.893094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Getting quotas for project 1c2141e33c264250aa7642f46a9b4048. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:24:59.897575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Getting quotas for user 776c647ef6d34d989ac12d4e91cc62ab and project 1c2141e33c264250aa7642f46a9b4048. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:24:59.908620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:24:59.911033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:24:59.957697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e9a2880d-aa46-4ee8-9715-e6f2a28d6e8f tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797161 Oct 05 20:24:59.958830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 248/502] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:24:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:24:59.969428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-873359d2-3375-425e-8ff3-20b4d168dcf3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:24:59.970331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-873359d2-3375-425e-8ff3-20b4d168dcf3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:00.031592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-873359d2-3375-425e-8ff3-20b4d168dcf3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:00.038408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-873359d2-3375-425e-8ff3-20b4d168dcf3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1218 microversion: 2.1 time: 0.072877 Oct 05 20:25:00.038979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 255/503] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:24:59 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:00.707245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:00.707850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:00.714497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:00.714983 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:00.715479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:00.716176 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:00.716625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:00.717047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:00.843987 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:00.852128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-72513049-4f86-428f-9a48-dd87e3c5a70b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.149152 Oct 05 20:25:00.852694 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 249/504] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:00 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:00.882612 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:00.883244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:00.890714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:00.891198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:00.891634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:00.892319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:00.892771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:00.893222 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:01.023173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:01.032362 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:01.033819 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:01.036257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-31a649af-ddb7-4b29-a18d-822102e84de9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.157561 Oct 05 20:25:01.036823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 256/505] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:00 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:01.061695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:01.062230 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:01.068414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:01.068896 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:01.069333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:01.070057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:01.070512 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:01.070938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:01.142706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:01.150163 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-39cd65fb-f72f-45c4-9af6-c19018f79192 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1214 microversion: 2.1 time: 0.092406 Oct 05 20:25:01.150717 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 250/506] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:01 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:01.876963 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:01.877507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:01.883734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:01.884218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:01.884642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:01.885319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:01.885791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:01.886209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:02.045835 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:02.054529 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-37e40ec7-8584-4e13-a957-9a1777c2573c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.181664 Oct 05 20:25:02.056812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 257/507] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:01 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:02.065308 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:02.066573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:02.076898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:02.077395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:02.078253 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:02.079275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:02.080383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:02.082899 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:02.173715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:02.174523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:02.180676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:02.181168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:02.181632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:02.182324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:02.182781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:02.183671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:02.258583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:02.269414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a08e7724-0adf-47b9-927d-22e154b674f2 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1270 microversion: 2.1 time: 0.099417 Oct 05 20:25:02.273592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 258/508] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:02 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1270 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:02.309337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:02.321450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:02.323139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:02.324434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2a40671d-ec80-47e7-957b-615766a587e9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.266889 Oct 05 20:25:02.325557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 251/509] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:02 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:03.079911 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:03.080512 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:03.086852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:03.087514 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:03.088162 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:03.088773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:03.089230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:03.089677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:03.239264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:03.250236 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4cf24849-286b-4edb-957f-e923ab582b68 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.174085 Oct 05 20:25:03.251418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 259/510] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:03 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:03.295616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:03.296535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:03.315658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:03.317433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:03.319103 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:03.319849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:03.320306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:03.320730 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:03.354129 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:03.355173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:03.368711 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:03.373414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:03.381804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:03.382639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:03.383299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:03.383738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:03.454414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:03.464279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6ac64459-8c35-46c2-bc60-346790dd2276 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1276 microversion: 2.1 time: 0.175043 Oct 05 20:25:03.479724 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 252/511] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:03 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:03.578325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:03.601881 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:03.607390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:03.609451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5a85e177-590d-4d57-ba3a-3c5bd59c178e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.260961 Oct 05 20:25:03.610845 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 260/512] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:03 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:04.280993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:04.282783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:04.289638 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:04.290135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:04.290577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:04.291337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:04.291751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:04.292179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:04.443295 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:04.451499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4d6dde99-5caa-45ff-9f0c-b7364bf0d066 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.175130 Oct 05 20:25:04.452062 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 253/513] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:04 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:04.490078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:04.490688 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:04.497120 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:04.497635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:04.498072 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:04.498754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:04.499208 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:04.499630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:04.639041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:04.639654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:04.645424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:04.645974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:04.646410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:04.647116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:04.647571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:04.647995 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:04.650336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:04.658681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-45b6b29e-e2c5-4e7e-aa01-c5f5553b477c tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.172479 Oct 05 20:25:04.659320 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 261/514] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:04 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:04.782179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:04.791536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:04.793256 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:04.795980 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b9479f53-6c6a-4ee1-9e80-0b7d27ae5607 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.161698 Oct 05 20:25:04.797002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 254/515] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:04 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:25:05.475286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:05.475895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:05.481885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:05.482368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:05.482803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:05.483494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:05.483944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:05.484361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:05.614708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:05.623432 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-140ac125-66cc-486d-acac-4958e20319fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.151990 Oct 05 20:25:05.624009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 262/516] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:05 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:05.683065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:05.684667 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:05.691587 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:05.692446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:05.693002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:05.693806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:05.694336 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:05.694862 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:05.697726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:05.822216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:05.822828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:05.827023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:05.828892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:05.829388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:05.829862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:05.830573 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:05.831029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:05.831456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:05.834612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b45cc15b-6225-4b0d-babe-cd8358aa6a8e tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.156793 Oct 05 20:25:05.835172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 255/517] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:05 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:05.972500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:05.981197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:05.982670 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:05.983831 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-762aa00b-3211-4e26-b6cb-42650f53bcd5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.165573 Oct 05 20:25:05.984386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 263/518] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:05 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:25:06.649805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:06.650472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:06.656921 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:06.657500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:06.658049 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:06.658836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:06.659370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:06.659870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:06.797400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:06.806588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7a7b3a9c-8111-4162-8cc9-9435a53b3542 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.160610 Oct 05 20:25:06.809332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 256/519] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:06 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:06.857406 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:06.858043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:06.864417 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:06.864872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:06.865297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:06.866001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:06.866446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:06.866862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:07.007033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:07.015207 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:07.015827 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:07.017938 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3ef97562-d9dc-4e1c-b412-e01928b559f7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.164059 Oct 05 20:25:07.018835 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 264/520] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:06 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:07.025617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:07.026217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:07.026729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:07.027516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:07.028594 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:07.029099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:07.181565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:07.190214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:07.191790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:07.193315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2da2e93b-849a-4530-a4a7-3d1ea7e8aade tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.182708 Oct 05 20:25:07.197125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 257/521] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:07 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:07.831828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:07.832439 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:07.838508 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:07.839000 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:07.839441 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:07.840160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:07.840615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:07.841040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:07.983566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:07.992089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7c3d4bf8-e4ed-4446-b0b8-cbc0e4ad889e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.164215 Oct 05 20:25:07.992653 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 265/522] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:07 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:08.040122 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:08.040744 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:08.043412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:08.049287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:08.049860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:08.050309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:08.051009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:08.051468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:08.051898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:08.192859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:08.201819 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f3ddaf61-bc09-475d-be3d-25d36f118da6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.165455 Oct 05 20:25:08.213537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 258/523] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:08 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:08.219914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:08.221031 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:08.227104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:08.227583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:08.228011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:08.228729 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:08.229180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:08.229727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:08.362292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:08.370822 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:08.372918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:08.374131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a42d7c31-7980-42fb-bee9-2522357d4903 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.159406 Oct 05 20:25:08.374688 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 266/524] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:08 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:09.016091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:09.016728 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:09.022640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:09.023123 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:09.023548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:09.024233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:09.024692 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:09.025113 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:09.172826 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:09.181255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0b798682-d242-43d2-80c6-c85dd05ba397 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.169567 Oct 05 20:25:09.181859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 259/525] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:09 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:09.226354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:09.226949 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:09.233341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:09.233852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:09.234287 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:09.234971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:09.235421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:09.235841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:09.254552 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:09.380451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:09.388427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-203b71ef-327e-4384-ae03-ed5235e7f066 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.165775 Oct 05 20:25:09.389333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 267/526] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:09 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:09.399533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:09.400139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:09.408719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:09.409419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:09.410049 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:09.410916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:09.411546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:09.412092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:09.552802 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:09.562083 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:09.563524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:09.564672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ba534963-f1bd-48bd-9cd9-2339c5f0d77b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.169117 Oct 05 20:25:09.565220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 260/527] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:09 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:10.206391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:10.207039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:10.209239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:10.214580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:10.215076 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:10.215512 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:10.216209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:10.216664 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:10.217089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:10.365914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:10.374994 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-469ab54f-469e-4ae0-8d43-35268decca55 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.172555 Oct 05 20:25:10.375772 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 268/528] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:10 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:10.411794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:10.412498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:10.415192 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:10.415192 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=6 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:10.421636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:10.422119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:10.422552 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:10.423251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:10.423700 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:10.424125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:10.576705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:10.584640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a3efa558-e11d-4e66-8895-fbce3e5079ac tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.176677 Oct 05 20:25:10.585500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 261/529] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:10 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:10.597408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:10.598156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:10.604713 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:10.605208 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:10.606214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:10.606928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:10.607384 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:10.607809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:10.748449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:10.759131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:10.761021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:10.762298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5777dfb4-819d-45e5-a4ea-b8d9650aeb97 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.168932 Oct 05 20:25:10.763054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 269/530] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:10 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:25:11.399877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:11.400483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:11.407305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:11.407798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:11.408242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:11.408974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:11.409437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:11.409911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:11.549693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:11.557938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-61a47bf1-570f-41a0-b8b5-5fb19bd09895 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.161873 Oct 05 20:25:11.558496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 262/531] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:11 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:11.608032 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:11.608738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:11.615694 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:11.616189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:11.616624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:11.617329 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:11.617808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:11.618231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:11.766658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:11.775838 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fe7fc1cc-4fd0-4742-b9f3-d67e28c2effe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.172035 Oct 05 20:25:11.794159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 270/532] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:11 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:11.798997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:11.799614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:11.806754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:11.807348 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:11.807794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:11.808618 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:11.809094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:11.809674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:11.951797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:11.960897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:11.962313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:11.963489 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2a897e1f-3fbb-4c4c-98cb-a0cbf51fd3a2 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.168840 Oct 05 20:25:11.964848 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 263/533] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:11 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:12.522579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:12.522976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:12.528922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.529406 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:12.529935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:12.530669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.531121 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:12.531544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:12.554780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3509fd2c-c427-4ab2-b41e-d5a04870be59 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/ips" status: 200 len: 151 microversion: 2.1 time: 0.036144 Oct 05 20:25:12.555345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 271/534] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:25:12 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:12.583266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:12.584504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:12.592571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.593659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:12.594401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:12.595464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.596206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:12.596845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:12.781432 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:12.790908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-225637c5-f65b-4a5a-9349-c1c6caafdeed tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.211418 Oct 05 20:25:12.801383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:12.802726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:12.803334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 264/535] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:12 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:12.823320 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.824231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:12.825044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:12.826054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.826730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:12.833896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:12.990952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:12.992039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:12.998383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:12.999104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:13.000314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:13.001994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:13.002944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:13.003692 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:13.045190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:13.056622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-aacc12ad-d0ae-4086-b40d-6425474989c8 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.259597 Oct 05 20:25:13.057324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 272/536] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:12 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:13.143186 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:13.151874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:13.153884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:13.155078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-abdd3ba0-f2ec-445f-9a40-f169902ffa91 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.168785 Oct 05 20:25:13.155640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 265/537] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:12 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:25:13.818117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:13.818717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:13.825163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:13.825676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:13.826112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:13.826793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:13.827245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:13.827662 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:13.955977 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:13.964045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ad37647a-20f0-4b18-959a-470063a8c04f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.150069 Oct 05 20:25:13.964609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 273/538] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:13 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:14.023172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2103c4ab-0784-4c35-8f17-c851131697c0"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:14.025557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:14.031966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.032449 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.032884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.033595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.034054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.034495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.081388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:14.082536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:14.091172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.092783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.093468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.094409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.094974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.095516 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.233330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:14.241284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8de5de6a-d2ba-4fad-94a3-47a4b863b3b1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.164635 Oct 05 20:25:14.241878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 274/539] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:14 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:14.246970 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:14.247558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:14.253312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.253823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.254252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.254934 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.255381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.255803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.391579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:14.400744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:14.402229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:14.404067 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f681b740-b57f-4b46-91e2-a3b8dc531e1a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.161274 Oct 05 20:25:14.404632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 275/540] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:14 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:14.837812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-daf2c5fb-6b7f-4f50-884c-8c600eba117f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.818250 Oct 05 20:25:14.843832 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 266/541] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:25:14 2022] POST /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:14.850298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-7930657c-f8d8-475d-8e08-7f8182ac35b7 req-868b5621-450f-4d5f-bfaf-df6ecea27342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539f21da-6837-47f9-9cb3-079290fdc4e4", "tag": "ce1ca4ad-a5d4-4707-8a17-35a71cff2c21"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:14.867714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-7930657c-f8d8-475d-8e08-7f8182ac35b7 req-868b5621-450f-4d5f-bfaf-df6ecea27342 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.868614 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-7930657c-f8d8-475d-8e08-7f8182ac35b7 req-868b5621-450f-4d5f-bfaf-df6ecea27342 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.869142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-7930657c-f8d8-475d-8e08-7f8182ac35b7 req-868b5621-450f-4d5f-bfaf-df6ecea27342 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.884235 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-7930657c-f8d8-475d-8e08-7f8182ac35b7 req-868b5621-450f-4d5f-bfaf-df6ecea27342 service nova] Creating event network-changed:ce1ca4ad-a5d4-4707-8a17-35a71cff2c21 for instance 539f21da-6837-47f9-9cb3-079290fdc4e4 on hv-cinder-80152 Oct 05 20:25:14.892516 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-7930657c-f8d8-475d-8e08-7f8182ac35b7 req-868b5621-450f-4d5f-bfaf-df6ecea27342 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046564 Oct 05 20:25:14.893607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 276/542] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:14.988298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:14.988965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:14.997650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.998159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:14.998584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:14.999294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:14.999995 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.000431 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.200604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:15.208998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bdfa08e8-aa43-432e-b9ab-3cba51c0941e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1702 microversion: 2.1 time: 0.225069 Oct 05 20:25:15.209588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 267/543] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:14 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1702 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:15.233469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c4f3f1d2-5bb5-42f6-a833-8a3ec24d715b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:15.240195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c4f3f1d2-5bb5-42f6-a833-8a3ec24d715b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.240717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c4f3f1d2-5bb5-42f6-a833-8a3ec24d715b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.241188 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c4f3f1d2-5bb5-42f6-a833-8a3ec24d715b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.265972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:15.266775 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:15.272739 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.273367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.274050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.274859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.275547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.276081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.305670 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c4f3f1d2-5bb5-42f6-a833-8a3ec24d715b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Going to try to start instance {{(pid=120351) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 20:25:15.349100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c4f3f1d2-5bb5-42f6-a833-8a3ec24d715b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action" status: 202 len: 0 microversion: 2.1 time: 0.120281 Oct 05 20:25:15.349746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 277/544] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:25:15 2022] POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:25:15.358370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:15.359071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:15.366070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.366814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.366994 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.368409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.368409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.368638 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.459871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:15.470545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-88668a78-e338-43c6-b1bf-f481e611f8e3 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.208307 Oct 05 20:25:15.471791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 268/545] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:15 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:15.477551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:15.478455 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:15.486595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.487567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.488219 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.488937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:15.489592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:15.490024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:15.529654 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:15.538582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-568cac45-6860-47d0-96c9-22c6bbf60f26 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1711 microversion: 2.1 time: 0.184374 Oct 05 20:25:15.539339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 278/546] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:15 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1711 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:15.630093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:15.639934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:15.641381 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:15.642568 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-94ab1de6-02ba-41e5-bc70-30401e7ceaf3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.169494 Oct 05 20:25:15.643131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 269/547] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:15 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:16.499138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:16.499778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:16.506271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:16.506952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:16.507397 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:16.508718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:16.509347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:16.509970 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:16.562940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:16.563559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:16.570356 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:16.570846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:16.571282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:16.571984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:16.572441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:16.572868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:16.588900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:16.715458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:16.723607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0b577a8b-e41b-45eb-ae47-83744705a193 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.228866 Oct 05 20:25:16.737858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 279/548] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:16 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:16.743428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:16.744125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:16.750677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:16.751166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:16.751603 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:16.752443 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:16.752931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:16.753356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:16.850014 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:16.860035 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-86270a0d-b7b5-4b0a-8a61-a6cc2f0c9ac2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1711 microversion: 2.1 time: 0.300898 Oct 05 20:25:16.860629 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 270/549] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:16 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1711 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:16.974234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:16.986640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:16.987735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:16.989458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4494e405-4a9d-4518-898f-874a0e790fdb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.250612 Oct 05 20:25:16.990018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 280/550] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:16 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:17.750684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:17.751305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:17.757491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:17.757993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:17.758421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:17.759100 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:17.759547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:17.759963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:17.884796 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:17.885407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:17.888484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:17.892493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:17.892987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:17.893427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:17.894216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:17.894677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:17.895105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:17.896046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-42cad072-a04c-4236-aacc-0616508084c7 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.149365 Oct 05 20:25:17.896616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 271/551] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:17 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:18.016022 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:18.016663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:18.022658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:18.023211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:18.023714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:18.024478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:18.024755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:18.025075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:18.025597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:18.033824 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a992a035-b079-42b2-b361-4d9f8d5873cd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1711 microversion: 2.1 time: 0.153248 Oct 05 20:25:18.034426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 281/552] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:17 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1711 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:18.167495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:18.178391 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:18.179846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:18.181022 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4e9a753e-4215-4f9f-8d30-20d347ab1b9b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.169532 Oct 05 20:25:18.181600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 272/553] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:18 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:25:18.919259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:18.919991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:18.922398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 20:25:18.922558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Wed Oct 5 20:25:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 (ip 10.222.0.23) !!! Oct 05 20:25:18.930238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:18.930717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:18.931153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:18.931850 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:18.932300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:18.932723 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:19.058332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:19.059469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:19.059570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:19.065914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:19.066396 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:19.066827 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:19.067451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7b5316cc-c966-4b45-981a-451f2db29d18 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.151822 Oct 05 20:25:19.067776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:19.068075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 282/554] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:18 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:19.068227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:19.068650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:19.195354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:19.203578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-98cfbcef-aefb-4660-bf61-699d240603db tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1715 microversion: 2.1 time: 0.149049 Oct 05 20:25:19.204143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 273/555] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:19 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:19.206530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:19.207170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:19.212975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:19.213456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:19.213918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:19.215099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:19.215590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:19.216010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:19.587700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:19.596785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:19.598267 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:19.599402 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6394b7fd-930a-40aa-b300-69ab862cee40 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.396891 Oct 05 20:25:19.599977 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 283/556] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:19 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:25:20.091312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:20.091930 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:20.098404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:20.098891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:20.099327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:20.100052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:20.100511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:20.100944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:20.240666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:20.248997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6ced3c8d-74b9-424e-9ff3-2032950837c1 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.162162 Oct 05 20:25:20.249762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 274/557] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:20 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:20.324388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-0e5e2e39-76a7-4e36-a0ff-65522aa39cf0 req-effc8901-5c70-49ea-943b-65e497ca9c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539f21da-6837-47f9-9cb3-079290fdc4e4", "name": "network-vif-plugged", "status": "completed", "tag": "ce1ca4ad-a5d4-4707-8a17-35a71cff2c21"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:20.335522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0e5e2e39-76a7-4e36-a0ff-65522aa39cf0 req-effc8901-5c70-49ea-943b-65e497ca9c42 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:20.336130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0e5e2e39-76a7-4e36-a0ff-65522aa39cf0 req-effc8901-5c70-49ea-943b-65e497ca9c42 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:20.336654 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0e5e2e39-76a7-4e36-a0ff-65522aa39cf0 req-effc8901-5c70-49ea-943b-65e497ca9c42 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:20.341309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:20.349461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-0e5e2e39-76a7-4e36-a0ff-65522aa39cf0 req-effc8901-5c70-49ea-943b-65e497ca9c42 service nova] Creating event network-vif-plugged:ce1ca4ad-a5d4-4707-8a17-35a71cff2c21 for instance 539f21da-6837-47f9-9cb3-079290fdc4e4 on hv-cinder-80152 Oct 05 20:25:20.354437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-0e5e2e39-76a7-4e36-a0ff-65522aa39cf0 req-effc8901-5c70-49ea-943b-65e497ca9c42 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033761 Oct 05 20:25:20.355786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 284/558] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:20.624866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:20.625470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:20.631412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:20.631886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:20.632333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:20.633007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:20.633576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:20.634193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:20.764810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:20.773233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:20.774713 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:20.775864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-65583e3a-8205-4abd-aa92-26f8fa87cfcf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.155385 Oct 05 20:25:20.776426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 275/559] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:20 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:21.272671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:21.273373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:21.280012 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:21.280488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:21.280919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:21.281615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:21.282068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:21.282503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:21.411907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:21.419481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2c76a5e6-e770-458a-a01b-eddf70cfc9d6 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.151329 Oct 05 20:25:21.420047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 285/560] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:21 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:21.801752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:21.802358 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:21.809195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:21.809700 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:21.810133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:21.810811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:21.811277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:21.811701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:21.938558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:21.947334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:21.948788 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:21.950013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6835d1e3-aefa-4dc9-acb3-ed00748ef69b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.152236 Oct 05 20:25:21.950583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 276/561] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:21 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:22.442611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:22.443216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:22.449687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:22.450155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:22.450585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:22.451273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:22.451722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:22.452181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:22.582095 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:22.589635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e01387f7-af09-4ac6-bd9b-1172e3eb3184 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1318 microversion: 2.1 time: 0.151171 Oct 05 20:25:22.590198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 286/562] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:22 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:22.975733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:22.976334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:22.982697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:22.983178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:22.983610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:22.984299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:22.984748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:22.985168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:23.114150 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:23.122506 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:23.123941 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:23.125089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cc2ad05d-4a87-425b-af35-8b331f76c81a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.153272 Oct 05 20:25:23.125667 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 277/563] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:22 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:23.611725 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:23.613367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:23.618843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:23.619327 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:23.619758 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:23.620444 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:23.621407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:23.621853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:23.757128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:23.765462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-337779e1-59ca-4ba9-9ba2-28c0c08a5afb tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1506 microversion: 2.1 time: 0.157602 Oct 05 20:25:23.766062 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 287/564] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:23 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:23.788462 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3cc682e7-6c5a-4037-91f3-39eeefa686d8", "device": "/dev/sdb"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:23.791507 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:23.797937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:23.798471 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:23.798906 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:23.799602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:23.800049 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:23.800470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:24.075774 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c23cd15e-5b2c-4b36-9d87-892eb48a77ce tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "POST /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291934 Oct 05 20:25:24.076411 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 278/565] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:25:23 2022] POST /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:24.150530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:24.151139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:24.157793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:24.158274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:24.158707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:24.159392 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:24.159843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:24.160260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:24.295912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:24.304119 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:24.305729 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:24.306921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-28d5ff1f-ed54-4198-bc05-a10ede1244bc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.160233 Oct 05 20:25:24.307672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 288/566] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:24 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:24.524134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-189fcdeb-c2cc-406d-9c50-12edc387092b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: .version_select at 0x7f3e02556ca0>, body: {"keypair": {"name": "tempest-keypair-761224161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx4qgKqjP/b7/m9nu/KhCLn3pbXGbZKNH3VBUvmIrTlxrDdIPXBY9Ymuw5OmZuTUOUjtFQ03Xx0aUcy3x1lIf1c8bwBtBf7ucJO89763BM0zSrhsvtFt4r8Q86tnco2Vw=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:24.539457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-189fcdeb-c2cc-406d-9c50-12edc387092b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:25:24.543831 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-189fcdeb-c2cc-406d-9c50-12edc387092b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:25:24.565323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-189fcdeb-c2cc-406d-9c50-12edc387092b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045560 Oct 05 20:25:24.565940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 279/567] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:25:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:25.333078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:25.333847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:25.340493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:25.341150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:25.341929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:25.342741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:25.343259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:25.343689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:25.551714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:25.561210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:25.562773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:25.563893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-39cefe15-d8bb-43ef-83f1-d4c405b8e5e8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.234936 Oct 05 20:25:25.564428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 289/568] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:25 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:25.926678 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-228724349", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b866581-0156-4c8b-8621-7be5c67dfe5d"}], "security_groups": [{"name": "tempest-securitygroup--1443102752"}], "key_name": "tempest-keypair-761224161", "user_data": "}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:26.030249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] validate_networks() for [('9b866581-0156-4c8b-8621-7be5c67dfe5d', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:25:26.351695 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-054d1da1-1572-4819-b0b8-6d2bc985e20e req-acd055e7-d4f0-4e15-a227-49d972047038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "name": "network-vif-plugged", "status": "completed", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:26.358338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:26.363535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-054d1da1-1572-4819-b0b8-6d2bc985e20e req-acd055e7-d4f0-4e15-a227-49d972047038 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:26.364086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-054d1da1-1572-4819-b0b8-6d2bc985e20e req-acd055e7-d4f0-4e15-a227-49d972047038 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:26.364579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-054d1da1-1572-4819-b0b8-6d2bc985e20e req-acd055e7-d4f0-4e15-a227-49d972047038 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:26.377793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-054d1da1-1572-4819-b0b8-6d2bc985e20e req-acd055e7-d4f0-4e15-a227-49d972047038 service nova] Creating event network-vif-plugged:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:25:26.382886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-054d1da1-1572-4819-b0b8-6d2bc985e20e req-acd055e7-d4f0-4e15-a227-49d972047038 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035085 Oct 05 20:25:26.383734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 290/569] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:25:26.403552 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:25:26.404043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:25:26.404515 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:25:26.404915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:25:26.405374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:25:26.414343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:26.414826 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:26.415265 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:26.415968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:26.416411 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:26.416826 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:26.433752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:25:26.437649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:25:26.448957 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:25:26.451376 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:25:26.498511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-93a7dc37-ecee-483a-b7b8-dbff711dcc85 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.576738 Oct 05 20:25:26.499078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 280/570] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:25:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:25:26.510594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c0382837-7664-4856-8605-f02585bb4a48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:26.511296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c0382837-7664-4856-8605-f02585bb4a48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:26.567819 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c0382837-7664-4856-8605-f02585bb4a48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:26.575417 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c0382837-7664-4856-8605-f02585bb4a48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1240 microversion: 2.1 time: 0.068944 Oct 05 20:25:26.575991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 291/571] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:26 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:26.591175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:26.591888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:26.598173 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:26.598658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:26.599096 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:26.599792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:26.600327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:26.600718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:26.740637 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:26.749972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:26.751437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:26.752666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0a538864-83dc-454c-bcbc-4604438901ed tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.166398 Oct 05 20:25:26.753298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 281/572] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:26 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:27.599582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:27.600187 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:27.607381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:27.607857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:27.608286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:27.608967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:27.609437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:27.609882 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:27.674369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:27.681933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-26868c98-4394-45d9-ad5f-ad90d93b00c7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1292 microversion: 2.1 time: 0.086176 Oct 05 20:25:27.682488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 292/573] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:27 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:27.778652 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:27.779255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:27.785582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:27.786055 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:27.786501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:27.787162 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:27.787609 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:27.788025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:27.923580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:27.932126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:27.934314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:27.935469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-20c914da-c7fd-4724-9f38-94a26859c382 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.160714 Oct 05 20:25:27.936020 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 282/574] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:27 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:28.706053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:28.706748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:28.713179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:28.713699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:28.714136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:28.714837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:28.715298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:28.715726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:28.776451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:28.784210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fdc6fac4-0c9e-452b-9cd2-0a66653d24c9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1292 microversion: 2.1 time: 0.082177 Oct 05 20:25:28.784774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 293/575] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:28 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1292 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:28.961191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:28.961748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:28.968033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:28.968510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:28.968942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:28.969668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:28.970119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:28.970540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:29.112603 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:29.122223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:29.123674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:29.124900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-aac8a521-2a87-496f-9f2f-0756af346193 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1808 microversion: 2.20 time: 0.167611 Oct 05 20:25:29.125367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 283/576] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:28 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:29.806735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:29.807347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:29.814452 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:29.814940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:29.815380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:29.816075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:29.816530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:29.816956 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:29.888433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:29.896143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-002dd843-c2b0-40a8-a0a5-51e666e0d849 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1298 microversion: 2.1 time: 0.093218 Oct 05 20:25:29.896721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 294/577] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:29 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1298 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:30.149893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:30.150517 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:30.157614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:30.158133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:30.158575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:30.159283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:30.159736 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:30.160169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:30.287926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:30.297214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:30.298688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:30.299849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c3e62368-1691-4f91-a44a-7e676a854cd3 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1795 microversion: 2.20 time: 0.153959 Oct 05 20:25:30.300407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 284/578] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:25:30 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:25:30.920321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:30.920930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:30.927323 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:30.927805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:30.928235 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:30.928921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:30.929370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:30.929814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:31.055393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:31.063543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-cb8a8a0e-31c7-4642-afd5-8a1d69552181 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.147943 Oct 05 20:25:31.064105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 295/579] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:30 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:31.777868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-0821a60b-b8f8-4bc8-8c58-4e1ea89b864a req-45eabd15-313d-42c0-8bd1-39c2d5965859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd5c8f4-254b-4924-a74a-8f5b8f190b48", "tag": "6bf325fe-56f6-427f-8567-d1c8aa923356"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:31.787958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-0821a60b-b8f8-4bc8-8c58-4e1ea89b864a req-45eabd15-313d-42c0-8bd1-39c2d5965859 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:31.788822 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-0821a60b-b8f8-4bc8-8c58-4e1ea89b864a req-45eabd15-313d-42c0-8bd1-39c2d5965859 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:31.789471 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-0821a60b-b8f8-4bc8-8c58-4e1ea89b864a req-45eabd15-313d-42c0-8bd1-39c2d5965859 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:31.801460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-0821a60b-b8f8-4bc8-8c58-4e1ea89b864a req-45eabd15-313d-42c0-8bd1-39c2d5965859 service nova] Creating event network-changed:6bf325fe-56f6-427f-8567-d1c8aa923356 for instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 on hv-cinder-80152 Oct 05 20:25:31.806315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-0821a60b-b8f8-4bc8-8c58-4e1ea89b864a req-45eabd15-313d-42c0-8bd1-39c2d5965859 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032889 Oct 05 20:25:31.806908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 285/580] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:25:32.086924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:32.087533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:32.093942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:32.094425 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:32.094860 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:32.095544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:32.095995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:32.096416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:32.226596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:32.234687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b944c48c-7c4b-4c93-a7a4-c008a873ac8a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.151633 Oct 05 20:25:32.235250 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 296/581] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:32 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:33.258215 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:33.258903 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:33.265531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:33.266024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:33.266454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:33.267140 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:33.267585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:33.268005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:33.399351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:33.406895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ea1b2c9c-5b7a-46e0-aff9-5b174f8a037d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.153457 Oct 05 20:25:33.407470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 286/582] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:33 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:34.139385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "441aeb36-a020-447a-901e-c21aa03edf43"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:34.141814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:34.148280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:34.148751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:34.149191 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:34.149974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:34.150433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:34.150856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:34.429392 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:34.429944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:34.436838 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:34.437316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:34.437896 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:34.438583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:34.439031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:34.439452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:34.566629 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:34.574592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9b33d579-3308-4660-bdae-a3f6dd64b2ef tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.149059 Oct 05 20:25:34.575163 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 287/583] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:34 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:35.596538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:35.597256 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:35.603602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:35.604080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:35.604513 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:35.605208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:35.605708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:35.606167 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:35.610166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:35.740578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:35.748332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0b0f5c6f-2f79-4605-bad1-85ea8779e444 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.155702 Oct 05 20:25:35.748905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 288/584] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:35 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:25:36.358745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-984304e7-788e-47c5-99fa-e8a6e1ab1343 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.223171 Oct 05 20:25:36.359371 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 297/585] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:25:34 2022] POST /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 194 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:36.772800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:36.773415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:36.775320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:36.775988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=10 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:36.782808 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:36.783292 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:36.783762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:36.784460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:36.784916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:36.785346 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:36.917818 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:36.926038 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b51f748a-ffdc-455c-8140-c1ddc894db66 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.157095 Oct 05 20:25:36.926620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 289/586] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:36 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:37.949626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:37.950961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:37.953378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:37.959203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:37.959683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:37.960117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:37.960805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:37.961257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:37.961707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:38.090656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:38.098263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-88c28207-d65a-487c-bd64-8f0e668ff3c2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.152906 Oct 05 20:25:38.098832 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 298/587] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:37 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:39.122187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:39.124189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:39.130853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:39.132772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:39.133308 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:39.134043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:39.134934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:39.135418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:39.135946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:39.269987 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:39.277868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-73a53c94-b1a0-4a9b-8da7-5dd94e95c7a5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.160239 Oct 05 20:25:39.278971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 290/588] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:39 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:40.300874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:40.301482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:40.308014 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:40.308495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:40.308928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:40.310300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:40.310721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:40.311141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:40.446021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:40.454287 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0f31f2d0-c933-4351-a4d0-f5c45662f513 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.157235 Oct 05 20:25:40.454844 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 299/589] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:40 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:40.843707 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-eab54763-6c80-4bb0-9cda-041d0c43ca93 req-5f69ba0f-781a-46ea-a1c5-9615fb9299e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd5c8f4-254b-4924-a74a-8f5b8f190b48", "name": "network-vif-plugged", "status": "completed", "tag": "6bf325fe-56f6-427f-8567-d1c8aa923356"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:40.854436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-eab54763-6c80-4bb0-9cda-041d0c43ca93 req-5f69ba0f-781a-46ea-a1c5-9615fb9299e9 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:40.854655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-eab54763-6c80-4bb0-9cda-041d0c43ca93 req-5f69ba0f-781a-46ea-a1c5-9615fb9299e9 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:40.855120 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-eab54763-6c80-4bb0-9cda-041d0c43ca93 req-5f69ba0f-781a-46ea-a1c5-9615fb9299e9 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:40.868995 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-eab54763-6c80-4bb0-9cda-041d0c43ca93 req-5f69ba0f-781a-46ea-a1c5-9615fb9299e9 service nova] Creating event network-vif-plugged:6bf325fe-56f6-427f-8567-d1c8aa923356 for instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 on hv-cinder-80152 Oct 05 20:25:40.874248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-eab54763-6c80-4bb0-9cda-041d0c43ca93 req-5f69ba0f-781a-46ea-a1c5-9615fb9299e9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034484 Oct 05 20:25:40.875076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 291/590] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:41.476858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:41.477395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:41.483767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:41.484251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:41.484692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:41.485402 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:41.485996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:41.486431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:41.616351 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:41.624528 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0004463e-9bab-4776-b927-501835b6c1ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.151599 Oct 05 20:25:41.625097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 300/591] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:41 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:42.649607 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:42.650306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:42.657334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:42.657855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:42.658287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:42.658971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:42.659419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:42.659834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:42.792334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:42.800065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dbce4537-397f-45ec-bc35-e9f0fbda60ea tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1366 microversion: 2.1 time: 0.155536 Oct 05 20:25:42.800642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 292/592] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:42 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:43.429442 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:43.429957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:43.436993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:43.437469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:43.437932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:43.438619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:43.439069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:43.439488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:43.559464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:43.570589 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lazy-loading 'services' on Instance uuid 539f21da-6837-47f9-9cb3-079290fdc4e4 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:25:43.688349 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-726a0aae-3509-45c5-95a1-e2207d2040fe tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4/os-volume_attachments/3cc682e7-6c5a-4037-91f3-39eeefa686d8" status: 202 len: 0 microversion: 2.1 time: 0.262656 Oct 05 20:25:43.688990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 301/593] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:25:43 2022] DELETE /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4/os-volume_attachments/3cc682e7-6c5a-4037-91f3-39eeefa686d8 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:25:43.822935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:43.823550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:43.830578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:43.831061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:43.831492 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:43.832182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:43.832639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:43.833061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:43.962315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:43.970099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f470dc93-4b4f-400e-a2b1-abed1a8d98de tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1556 microversion: 2.1 time: 0.150923 Oct 05 20:25:43.970750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 293/594] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:43 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:43.993319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:43.993966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:44.000828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:44.001304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:44.001767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:44.002453 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:44.002905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:44.003325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:44.083903 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8223e4f1-cd92-4036-bcd0-79f8c5e34c98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094799 Oct 05 20:25:44.084500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 302/595] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:25:43 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:45.217475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-4b2d78f6-5670-41ef-9e28-78717d9e4fb1 req-cdd77f2b-bddd-4749-8b25-96f5ce1d228b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bd5c8f4-254b-4924-a74a-8f5b8f190b48", "tag": "6bf325fe-56f6-427f-8567-d1c8aa923356"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:45.227202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4b2d78f6-5670-41ef-9e28-78717d9e4fb1 req-cdd77f2b-bddd-4749-8b25-96f5ce1d228b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:45.227672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4b2d78f6-5670-41ef-9e28-78717d9e4fb1 req-cdd77f2b-bddd-4749-8b25-96f5ce1d228b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:45.228157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4b2d78f6-5670-41ef-9e28-78717d9e4fb1 req-cdd77f2b-bddd-4749-8b25-96f5ce1d228b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:45.239237 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-4b2d78f6-5670-41ef-9e28-78717d9e4fb1 req-cdd77f2b-bddd-4749-8b25-96f5ce1d228b service nova] Creating event network-changed:6bf325fe-56f6-427f-8567-d1c8aa923356 for instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 on hv-cinder-80152 Oct 05 20:25:45.244130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-4b2d78f6-5670-41ef-9e28-78717d9e4fb1 req-cdd77f2b-bddd-4749-8b25-96f5ce1d228b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030365 Oct 05 20:25:45.244723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 294/596] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:47.065041 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:47.068207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:47.074143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:47.074635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:47.075076 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:47.075764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:47.076217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:47.076640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:47.099043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'flavor' on Instance uuid 200392c4-aaf6-477e-a61a-45cf68f9b765 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:25:47.225634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2ceca113-f92c-489c-9f24-11e2dae7a2ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/action" status: 200 len: 32 microversion: 2.1 time: 0.165502 Oct 05 20:25:47.226242 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 303/597] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:25:47 2022] POST /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:25:47.237694 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:47.238501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:47.245348 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:47.245913 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:47.246353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:47.247865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:47.248366 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:47.248787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:47.384898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:47.393126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9aba74c5-40a1-4ade-b752-f82ce1e341ff tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.160258 Oct 05 20:25:47.393728 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 295/598] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:47 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:47.988283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:47.988860 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:47.994895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:47.995373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:47.995804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:47.996481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:47.996930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:47.997346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:48.021939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:25:48.095138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-64f6bf60-2348-4073-a383-08ba7a068a43 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "DELETE /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 204 len: 0 microversion: 2.1 time: 0.110830 Oct 05 20:25:48.095823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 304/599] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:25:47 2022] DELETE /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:25:48.104025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:48.104655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:48.110407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:48.110888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:48.111324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:48.112014 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:48.112466 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:48.112890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:48.237881 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:48.245408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-77c878ab-4cbb-48c2-bdf7-57e58f7264aa tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1512 microversion: 2.1 time: 0.145368 Oct 05 20:25:48.245992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 296/600] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:48 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1512 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:48.417257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:48.417992 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:48.423990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:48.424473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:48.424912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:48.425618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:48.426081 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:48.426505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:48.558365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:48.567318 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d56768fc-30b2-4caa-8bd2-96a652d82366 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.154041 Oct 05 20:25:48.567897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 305/601] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:48 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:49.269350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:49.269962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:49.276415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:49.276893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:49.277323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:49.278688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:49.279160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:49.279583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:49.413484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:49.421283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-41ccb880-297b-4d1b-8555-f029166d5fe4 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1512 microversion: 2.1 time: 0.155900 Oct 05 20:25:49.421877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 297/602] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:49 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:49.590637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:49.591846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:49.598331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:49.598810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:49.599237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:49.599921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:49.600365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:49.600779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:49.730879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:49.739158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e7eb2852-5d96-448a-92a1-7cf370a300f1 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.152493 Oct 05 20:25:49.739804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 306/603] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:49 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:50.444462 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:50.445212 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:50.451592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:50.452155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:50.452657 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:50.453414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:50.453890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:50.454318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:50.583123 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776c647ef6d34d989ac12d4e91cc62ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c2141e33c264250aa7642f46a9b4048', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:50.592244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dd376e63-b5cb-4e98-a66d-5538b3c23958 tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 200 len: 1512 microversion: 2.1 time: 0.151813 Oct 05 20:25:50.592839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 298/604] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:50 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:50.723962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-65f352a9-789d-4e7c-9373-e02fac2914e5 req-3f0287fb-fec3-4c14-8222-daad34533415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539f21da-6837-47f9-9cb3-079290fdc4e4", "name": "network-vif-deleted", "tag": "ce1ca4ad-a5d4-4707-8a17-35a71cff2c21"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:25:50.735632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-65f352a9-789d-4e7c-9373-e02fac2914e5 req-3f0287fb-fec3-4c14-8222-daad34533415 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:50.736109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-65f352a9-789d-4e7c-9373-e02fac2914e5 req-3f0287fb-fec3-4c14-8222-daad34533415 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:50.736533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-65f352a9-789d-4e7c-9373-e02fac2914e5 req-3f0287fb-fec3-4c14-8222-daad34533415 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:50.748313 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-65f352a9-789d-4e7c-9373-e02fac2914e5 req-3f0287fb-fec3-4c14-8222-daad34533415 service nova] Creating event network-vif-deleted:ce1ca4ad-a5d4-4707-8a17-35a71cff2c21 for instance 539f21da-6837-47f9-9cb3-079290fdc4e4 on hv-cinder-80152 Oct 05 20:25:50.753767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-65f352a9-789d-4e7c-9373-e02fac2914e5 req-3f0287fb-fec3-4c14-8222-daad34533415 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033607 Oct 05 20:25:50.754510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 307/605] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:25:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:25:50.763290 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:50.763895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:50.770529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:50.771020 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:50.771647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:50.772352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:50.772809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:50.773239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:50.909861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:50.918912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-166bf077-76e8-4336-8464-51dac6072eb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.159807 Oct 05 20:25:50.919621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 299/606] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:50 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:51.616322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:51.617013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] [instance: 539f21da-6837-47f9-9cb3-079290fdc4e4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:51.623789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:51.624259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:51.624686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:51.625361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:51.625859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:51.626275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:51.641358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] HTTP exception thrown: Instance 539f21da-6837-47f9-9cb3-079290fdc4e4 could not be found. Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Request method failure captured: Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 HTTP/1.1 Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPeenhZlvaPhWKob56bVKopUTmCLsnHEkzg4pKoKsZ8ojDyyij6tGQmp1oBIAYZWIbDrcivtsWMHCdkdTWjrcwpcL7P9N7GjX3VEW2pB5dVld0epRE8J3-od8JuBDHtAquczaWtUgaD2Hg7xKS8Q0PIX1gQFvA-cLT5YJokrd1sX35UM Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 1c2141e33c264250aa7642f46a9b4048 Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1842876056 Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:25:51.642971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/1c2141e33c264250aa7642f46a9b4048"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesSnapshotTestJSON-1842876056 Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 1c2141e33c264250aa7642f46a9b4048 Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1842876056 Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesSnapshotTestJSON-1842876056-project Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 776c647ef6d34d989ac12d4e91cc62ab Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesSnapshotTestJSON-1842876056-project Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 539f21da-6837-47f9-9cb3-079290fdc4e4 could not be found. Oct 05 20:25:51.645285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '539f21da-6837-47f9-9cb3-079290fdc4e4'} Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539f21da-6837-47f9-9cb3-079290fdc4e4 could not be found. Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:25:51.646181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539f21da-6837-47f9-9cb3-079290fdc4e4 could not be found. Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539f21da-6837-47f9-9cb3-079290fdc4e4 could not be found. Oct 05 20:25:51.647597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:25:51.648791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] Returning 404 to user: Instance 539f21da-6837-47f9-9cb3-079290fdc4e4 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:25:51.648791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7d8590df-e1c0-4555-9cfc-8aea3a94cf7a tempest-VolumesSnapshotTestJSON-1842876056 tempest-VolumesSnapshotTestJSON-1842876056-project] 10.222.0.23 "GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4" status: 404 len: 111 microversion: 2.1 time: 0.032176 Oct 05 20:25:51.648791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 308/607] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:51 2022] GET /compute/v2.1/servers/539f21da-6837-47f9-9cb3-079290fdc4e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:25:51.942551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:51.943169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:51.949745 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:51.950265 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:51.950706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:51.951398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:51.951854 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:51.952278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:52.084394 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:52.093079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3411521b-b2cc-4e3d-a0f3-d858c79d2b7a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.154840 Oct 05 20:25:52.093682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 300/608] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:51 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:53.117199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:53.117842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:53.124882 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:53.125398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:53.125916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:53.126751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:53.127052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:53.127475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:53.257218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:53.265322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-48aabaa5-6e90-4ea0-b2f4-3929a53b3032 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.153149 Oct 05 20:25:53.265905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 309/609] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:53 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:54.287751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:54.288357 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:54.294824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:54.295303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:54.295733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:54.296419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:54.296870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:54.297294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:54.422607 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:54.430685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9e7f4d83-92bd-470e-b8c8-883f5f31ddb7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.146767 Oct 05 20:25:54.431252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 301/610] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:54 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:55.455074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:55.455683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:55.462139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:55.462624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:55.463056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:55.463734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:55.464183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:55.464600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:55.593607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:55.601718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e58e4f65-2423-4ce5-9649-33877281dbc8 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.150437 Oct 05 20:25:55.602276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 310/611] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:55 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:56.625251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:56.626629 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:56.643084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:56.649903 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:56.650452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:56.651278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:56.652423 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:56.659585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:56.812693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:56.821136 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1cab7021-5aa1-47cb-885e-b6b22dc25582 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.200146 Oct 05 20:25:56.821733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 302/612] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:56 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:57.843929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:57.844539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:57.847639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:25:57.852847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:57.853330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:57.853852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:57.854622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:57.855160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:57.855634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:57.992800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:58.001565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5e702197-3f94-41e0-8002-f1d1e19d5d56 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.161380 Oct 05 20:25:58.002132 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 311/613] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:57 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:25:59.025821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:25:59.026486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:25:59.034099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:59.034589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:59.035025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:59.035721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:25:59.036175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:25:59.036598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:25:59.168006 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:25:59.176871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bb67d000-4314-4fe5-b12f-37470c253dae tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.155447 Oct 05 20:25:59.177400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 303/614] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:25:59 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:00.200786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:00.201324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:00.207795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:00.208272 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:00.208702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:00.209379 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:00.209857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:00.210273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:00.342289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:00.351939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6d99fc45-9a76-4cbb-8193-7961dc6d1f51 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.155038 Oct 05 20:26:00.352884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 312/615] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:00 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:01.376457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:01.377076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:01.383459 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:01.383945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:01.384388 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:01.385081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:01.385562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:01.385999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:01.511935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:01.520017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1aec0434-f9d4-4d4f-91d4-b36e534e2f87 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.148021 Oct 05 20:26:01.520587 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 304/616] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:01 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:02.543423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:02.544034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:02.551273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:02.551869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:02.552309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:02.553001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:02.553459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:02.553997 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:02.682432 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:02.690632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b5e96a75-d8ec-4454-baf2-4914e6be5a75 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.150985 Oct 05 20:26:02.691189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 313/617] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:02 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:03.714439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:03.715081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:03.721359 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:03.721864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:03.722296 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:03.722980 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:03.723428 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:03.723847 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:03.856270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:03.865148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0c650fe5-edc6-48fd-a5c1-d22eb0b50993 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.154586 Oct 05 20:26:03.865931 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 305/618] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:03 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:04.888362 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:04.888976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:04.896289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:04.896715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:04.897261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:04.898025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:04.898448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:04.898871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:05.033566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:05.041683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-012c580c-3e58-49f1-a918-ad55bbd5dd52 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.157366 Oct 05 20:26:05.042252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 314/619] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:04 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:06.065631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:06.066304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:06.072810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:06.073299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:06.073778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:06.074488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:06.074949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:06.075380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:06.079556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:06.201119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:06.209232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c25bd684-bcdd-470f-ac44-cdfb9214c176 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.147582 Oct 05 20:26:06.209839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 306/620] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:06 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:07.232580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:07.233192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:07.240135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:07.240610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:07.241043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:07.241750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:07.242201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:07.242618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:07.372919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:07.377301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:07.383080 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5154d3fb-437f-4597-815b-d36f2d3941d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.154218 Oct 05 20:26:07.383633 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 315/621] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:07 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:08.233248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:08.233920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:08.241015 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:08.241533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:08.241986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:08.242692 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:08.243157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:08.243589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:08.331936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lazy-loading 'services' on Instance uuid cc97e634-82d8-4433-bee0-6d00f84075e7 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:08.406195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ad4e0c9c-e6d0-4c6f-8b9c-59311f619e60 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-volume_attachments/0d9308f0-8799-4c26-961c-fde21921b453" status: 202 len: 0 microversion: 2.1 time: 0.176594 Oct 05 20:26:08.407000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 307/622] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:26:08 2022] DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-volume_attachments/0d9308f0-8799-4c26-961c-fde21921b453 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:08.407269 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:08.407951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:08.415381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:08.415861 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:08.416298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:08.416993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:08.417448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:08.417893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:08.547332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:08.555675 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ff38604c-81a5-4d2d-8c59-1dc477fac031 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.152983 Oct 05 20:26:08.556401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 316/623] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:08 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:09.582012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:09.582766 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:09.585405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=36 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:09.591387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:09.591888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:09.592330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:09.593143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:09.594107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:09.594107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:09.737721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:09.745808 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a4fd6940-e314-4f78-a6ba-2be59076eb33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.168192 Oct 05 20:26:09.746374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 308/624] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:09 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:10.771110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:10.771649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:10.778167 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:10.778655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:10.779094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:10.779790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:10.780252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:10.780678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:10.911651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:10.919912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d380ca82-b1fc-4c30-838a-b435e40b0d08 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.152750 Oct 05 20:26:10.920477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 317/625] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:10 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:11.652518 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1e0801cd-d632-408e-9604-3d75eae6ba8a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:11.659646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e0801cd-d632-408e-9604-3d75eae6ba8a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:11.660213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e0801cd-d632-408e-9604-3d75eae6ba8a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:11.660721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1e0801cd-d632-408e-9604-3d75eae6ba8a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:11.683270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1e0801cd-d632-408e-9604-3d75eae6ba8a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Going to try to stop instance {{(pid=120350) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 20:26:11.726477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1e0801cd-d632-408e-9604-3d75eae6ba8a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action" status: 202 len: 0 microversion: 2.1 time: 0.077734 Oct 05 20:26:11.727241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 309/626] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:26:11 2022] POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:11.735223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:11.738386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:11.741803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:11.742284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:11.742714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:11.743396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:11.743842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:11.744256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:11.882737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:11.891568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9edcfdc6-04a9-4b77-8532-d5fce0f72039 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1725 microversion: 2.1 time: 0.160295 Oct 05 20:26:11.892134 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 318/627] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:11 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:11.944427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:11.945128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:11.951388 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:11.951878 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:11.952828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:11.953551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:11.954017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:11.954445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:12.082367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:12.090392 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-913d7069-e905-46a4-9abd-9a4b6391c932 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1734 microversion: 2.1 time: 0.150392 Oct 05 20:26:12.090958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 310/628] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:11 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:12.916177 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:12.916791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:12.923262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:12.923762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:12.924273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:12.925045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:12.925628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:12.926152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.059084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:13.066840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bac00404-d336-415a-bc5e-2e487550f4a4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.154577 Oct 05 20:26:13.067671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 319/629] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:12 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:13.113837 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:13.114448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:13.120689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.121169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.121639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.122331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.122784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.123208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.253378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:13.261658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d8055e93-37be-4ac4-8e2a-8787721f4f33 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1714 microversion: 2.1 time: 0.152516 Oct 05 20:26:13.262229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 311/630] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:13 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1714 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:13.375910 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:13.376419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:13.384685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.385541 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.386299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.387065 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.387518 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.387946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.467265 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] HTTP exception thrown: Cannot 'detach_volume' instance 200392c4-aaf6-477e-a61a-45cf68f9b765 while it is in vm_state rescued Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Request method failure captured: Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments/441aeb36-a020-447a-901e-c21aa03edf43 HTTP/1.1 Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedipfPsghRxxr8JlXcA2OmTImyDJvKLT3ZxMSlNAaUg5XrSN9-akXCc_X8qyP0_ov5Kj8oFZRZM2CHjBRJRku916eEt1KspjId-ZunLkvqg2zi9a4bevsPaQ5xOs0KdcCUV4-Hd_9jKawtqrxpUAdLhl_ELaEi3U0IRlhNl4hufYdg Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:26:13.468785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07f868da50254a68bc692bca433d2699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07f868da50254a68bc692bca433d2699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 1301a78c1a684c94acb9f26b56f39f21 Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:26:13.470354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Cannot 'detach_volume' instance 200392c4-aaf6-477e-a61a-45cf68f9b765 while it is in vm_state rescued Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'server_id': '200392c4-aaf6-477e-a61a-45cf68f9b765', 'id': '441aeb36-a020-447a-901e-c21aa03edf43'} Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:26:13.471246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 200392c4-aaf6-477e-a61a-45cf68f9b765 while it is in vm_state rescued Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 200392c4-aaf6-477e-a61a-45cf68f9b765 while it is in vm_state rescued Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:13.472755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Returning 409 to user: Cannot 'detach_volume' instance 200392c4-aaf6-477e-a61a-45cf68f9b765 while it is in vm_state rescued {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:26:13.473922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6fe67ac2-32a3-456e-8e59-6d943cc245bb tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments/441aeb36-a020-447a-901e-c21aa03edf43" status: 409 len: 152 microversion: 2.1 time: 0.098984 Oct 05 20:26:13.473922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 320/631] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:26:13 2022] DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments/441aeb36-a020-447a-901e-c21aa03edf43 => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 20:26:13.479383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:13.479920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:13.486217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.486700 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.487137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.487833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.488297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.488725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.551692 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-256304b7-8f90-4513-82b8-375b39bb5145 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "POST /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/action" status: 202 len: 0 microversion: 2.1 time: 0.076018 Oct 05 20:26:13.552330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 312/632] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:26:13 2022] POST /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:26:13.560415 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:13.561028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:13.568151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.568644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.569077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.569808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:13.570258 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:13.570689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:13.773885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:13.782811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a47c8c43-1f20-48b6-8e2e-6de31edd838a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1722 microversion: 2.1 time: 0.226190 Oct 05 20:26:13.783386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 321/633] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:13 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:14.091109 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:14.091815 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:14.098961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:14.099447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:14.100067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:14.100778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:14.101234 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:14.101695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:14.313279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:14.321347 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1d372361-81a3-4404-8a0b-8e0708f117de tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.234535 Oct 05 20:26:14.321959 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 313/634] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:14 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:14.805464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:14.806247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:14.812333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:14.813500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:14.813969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:14.814710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:14.815110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:14.815539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:14.983485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:14.996862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4ff7d9a1-dcb0-4c31-99eb-cf0d89c41b72 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1722 microversion: 2.1 time: 0.195036 Oct 05 20:26:14.997657 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 322/635] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:14 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:15.344812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:15.345444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:15.351729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:15.352223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:15.352651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:15.353343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:15.353828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:15.354253 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:15.485295 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:15.493188 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7f9973b6-0343-4a38-8fbf-3df12afd82fe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.152907 Oct 05 20:26:15.493933 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 314/636] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:15 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:16.021300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:16.021945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:16.029367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:16.029891 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:16.030332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:16.031053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:16.032026 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:16.032455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:16.197932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:16.208398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-40416f30-462d-499c-9946-00a5f6c3627b tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1722 microversion: 2.1 time: 0.191196 Oct 05 20:26:16.209208 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 323/637] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:16 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:16.517645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:16.518270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:16.524754 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:16.525259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:16.525726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:16.526417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:16.526864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:16.527282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:16.659091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:16.667442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f6c5afdf-8465-4be1-b5f1-805416228923 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.153646 Oct 05 20:26:16.668060 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 315/638] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:16 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:17.232072 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:17.232816 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:17.239926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:17.240502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:17.240940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:17.241665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:17.242118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:17.242548 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:17.378639 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:17.387225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-17c8fb9d-5224-4d12-a7f5-778b393d6f67 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1728 microversion: 2.1 time: 0.158999 Oct 05 20:26:17.389558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 324/639] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:17 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:17.410179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:17.410670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:17.416400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:17.416824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:17.417254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:17.417970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:17.418417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:17.418835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:17.494655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-99be336a-dfd2-4b5b-8c5c-ffcf243a4ee9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088736 Oct 05 20:26:17.495245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 316/640] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:26:17 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:17.692556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:17.693191 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:17.699123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:17.699610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:17.700045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:17.700736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:17.701190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:17.701645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:17.836426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:17.844586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-07828bbc-3009-4fd1-b8f6-e2cad362393f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.156134 Oct 05 20:26:17.845246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 325/641] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:17 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:18.576459 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-321224ee-b2f2-4bec-a538-685966af7722 req-e77a38ac-f8ff-4c61-b4fa-9bb0edcabe79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200392c4-aaf6-477e-a61a-45cf68f9b765", "tag": "1c54cda3-3ed7-4392-b95f-fb3527c84492"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:18.586722 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-321224ee-b2f2-4bec-a538-685966af7722 req-e77a38ac-f8ff-4c61-b4fa-9bb0edcabe79 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:18.587199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-321224ee-b2f2-4bec-a538-685966af7722 req-e77a38ac-f8ff-4c61-b4fa-9bb0edcabe79 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:18.587626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-321224ee-b2f2-4bec-a538-685966af7722 req-e77a38ac-f8ff-4c61-b4fa-9bb0edcabe79 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:18.599591 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-321224ee-b2f2-4bec-a538-685966af7722 req-e77a38ac-f8ff-4c61-b4fa-9bb0edcabe79 service nova] Creating event network-changed:1c54cda3-3ed7-4392-b95f-fb3527c84492 for instance 200392c4-aaf6-477e-a61a-45cf68f9b765 on hv-cinder-80152 Oct 05 20:26:18.604520 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-321224ee-b2f2-4bec-a538-685966af7722 req-e77a38ac-f8ff-4c61-b4fa-9bb0edcabe79 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032704 Oct 05 20:26:18.605125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 317/642] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:18.871599 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:18.872296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:18.879773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:18.880261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:18.880689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:18.881691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:18.882291 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:18.882921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:19.015301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:19.023045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0b9599b2-22fa-47ad-abb9-8d69f333aa42 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.155278 Oct 05 20:26:19.023826 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 326/643] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:18 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:20.047835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:20.048537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:20.055242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.055716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.056153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.056844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.057298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.057749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.187175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:20.195130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4a7576eb-4495-471b-a581-58e38abd4a0e tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.152045 Oct 05 20:26:20.195695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 318/644] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:20 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:20.467047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:20.467687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:20.474971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.475459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.475888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.476583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.477100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.477692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.508489 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e8287777-f434-4481-83c6-61dbe732f11b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments/77b3ca04-3ee9-442f-8f9f-59f8f894b3c6" status: 200 len: 194 microversion: 2.20 time: 0.045480 Oct 05 20:26:20.509265 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 327/645] 10.222.0.23 () {60 vars in 1454 bytes} [Wed Oct 5 20:26:20 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments/77b3ca04-3ee9-442f-8f9f-59f8f894b3c6 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 20:26:20.589091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:20.589598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:20.595510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.595994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.596429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.597198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.597676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.598098 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.625810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-aad97313-6a81-438c-8ab2-ed5670a76fab req-751c401e-fe5c-46ae-a0cc-990b8c7e8e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200392c4-aaf6-477e-a61a-45cf68f9b765", "tag": "1c54cda3-3ed7-4392-b95f-fb3527c84492"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:20.645747 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-aad97313-6a81-438c-8ab2-ed5670a76fab req-751c401e-fe5c-46ae-a0cc-990b8c7e8e86 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.646659 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-aad97313-6a81-438c-8ab2-ed5670a76fab req-751c401e-fe5c-46ae-a0cc-990b8c7e8e86 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.647081 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-aad97313-6a81-438c-8ab2-ed5670a76fab req-751c401e-fe5c-46ae-a0cc-990b8c7e8e86 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.659205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-aad97313-6a81-438c-8ab2-ed5670a76fab req-751c401e-fe5c-46ae-a0cc-990b8c7e8e86 service nova] Creating event network-changed:1c54cda3-3ed7-4392-b95f-fb3527c84492 for instance 200392c4-aaf6-477e-a61a-45cf68f9b765 on hv-cinder-80152 Oct 05 20:26:20.664256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-aad97313-6a81-438c-8ab2-ed5670a76fab req-751c401e-fe5c-46ae-a0cc-990b8c7e8e86 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042687 Oct 05 20:26:20.666149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 328/646] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:26:20.700998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lazy-loading 'services' on Instance uuid 1f20ad33-5d0e-4324-b1b5-c8f823457933 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:20.774209 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f5d63286-15b1-4218-8c70-1e0ec7392493 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments/77b3ca04-3ee9-442f-8f9f-59f8f894b3c6" status: 202 len: 0 microversion: 2.20 time: 0.188723 Oct 05 20:26:20.774889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 319/647] 10.222.0.23 () {60 vars in 1457 bytes} [Wed Oct 5 20:26:20 2022] DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments/77b3ca04-3ee9-442f-8f9f-59f8f894b3c6 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:26:20.785898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:20.788422 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:20.796229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.797616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.798238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.798944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:20.799393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:20.799954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:20.831661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bf61b890-bca8-48fe-99a2-a0b3d317d58a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051077 Oct 05 20:26:20.832346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 329/648] 10.222.0.23 () {60 vars in 1343 bytes} [Wed Oct 5 20:26:20 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:26:21.219912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:21.220602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:21.226706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:21.227126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:21.227557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:21.228247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:21.228694 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:21.229113 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:21.243369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:21.361776 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:21.371153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1ec4fe4b-9622-40e8-92e4-4c3c69d41a51 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.155889 Oct 05 20:26:21.371830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 320/649] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:21 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:21.846685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:21.848884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:21.855544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:21.856024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:21.856455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:21.857142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:21.857642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:21.858044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:21.899416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-afd95d70-3a37-43fd-87bb-9157ef5d2944 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057649 Oct 05 20:26:21.899967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 330/650] 10.222.0.23 () {60 vars in 1343 bytes} [Wed Oct 5 20:26:21 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:21.964761 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:21.965252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:21.971450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:21.972027 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:21.972457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:21.973320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:21.973800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:21.974252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:21.999021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:26:22.078374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5b326d0b-d7d8-4927-91a2-0f50398c6236 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 204 len: 0 microversion: 2.20 time: 0.116511 Oct 05 20:26:22.079171 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 321/651] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Oct 5 20:26:21 2022] DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 20:26:22.087759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:22.088390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:22.094268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:22.094745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:22.095173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:22.095904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:22.096515 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:22.096975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:22.224490 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:22.232456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:22.233915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:22.235566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1d61a9c5-757e-4441-b103-817e64929346 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.151912 Oct 05 20:26:22.236110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 331/652] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:22 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:22.395638 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:22.396346 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:22.402799 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:22.403284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:22.403723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:22.404416 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:22.404873 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:22.405298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:22.533945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:22.541824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-198ac53d-cdc6-4a45-aa15-10bbac0f3d33 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.150344 Oct 05 20:26:22.542403 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 322/653] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:22 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:23.261707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:23.262425 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:23.269395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:23.269914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:23.270355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:23.271051 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:23.271510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:23.271936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:23.459272 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:23.467619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:23.469628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:23.470799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-979c7b19-850d-4708-8862-f568358120f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.213027 Oct 05 20:26:23.471355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 332/654] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:23 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:23.569281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:23.569950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:23.576249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:23.576734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:23.577170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:23.577972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:23.578428 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:23.578855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:23.713585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:23.721749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f2314011-98f5-483a-a3a6-6ff96328e1c2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1679 microversion: 2.1 time: 0.156549 Oct 05 20:26:23.722318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 323/655] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:23 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:24.498032 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:24.498918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:24.505868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:24.506178 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:24.506649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:24.507741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:24.508196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:24.508666 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:24.513254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:24.744405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:24.745551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:24.752718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:24.753218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:24.753669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:24.754398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:24.754853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:24.755279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:24.891793 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:24.894509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:24.900927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e6a56d39-14f4-4131-a1c3-4d65093c8229 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1656 microversion: 2.1 time: 0.160518 Oct 05 20:26:24.904596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:24.906950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:24.908187 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-883043f2-4f49-4399-a1e4-d5f70079609d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1723 microversion: 2.20 time: 0.414545 Oct 05 20:26:24.908636 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 333/656] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:24 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1723 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:24.918578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 324/657] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:24 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1656 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:24.929009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7014231d-d2b8-443a-9154-3bb53347ce79 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:24.936757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7014231d-d2b8-443a-9154-3bb53347ce79 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:24.937565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7014231d-d2b8-443a-9154-3bb53347ce79 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:24.938015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7014231d-d2b8-443a-9154-3bb53347ce79 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:24.960198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7014231d-d2b8-443a-9154-3bb53347ce79 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Going to try to start instance {{(pid=120351) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 20:26:25.012768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7014231d-d2b8-443a-9154-3bb53347ce79 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action" status: 202 len: 0 microversion: 2.1 time: 0.088543 Oct 05 20:26:25.022206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:25.022830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:25.026634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 334/658] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:26:24 2022] POST /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:25.030897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:25.031746 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:25.032380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:25.033262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:25.033909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:25.034350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:25.305834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:25.315213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3c5a0642-f859-4023-b3bb-c923b944f5eb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1665 microversion: 2.1 time: 0.296680 Oct 05 20:26:25.315884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 325/659] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:25 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1665 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:25.500036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-bb28f81c-137e-46cd-a745-885bbe8f8b87 req-f5a0c1a5-8901-4450-80ea-cd98010ae49a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f20ad33-5d0e-4324-b1b5-c8f823457933", "name": "network-vif-deleted", "tag": "179ef3ed-c463-418f-b678-aaee7de5535e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:25.520624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-bb28f81c-137e-46cd-a745-885bbe8f8b87 req-f5a0c1a5-8901-4450-80ea-cd98010ae49a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:25.521944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-bb28f81c-137e-46cd-a745-885bbe8f8b87 req-f5a0c1a5-8901-4450-80ea-cd98010ae49a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:25.522626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-bb28f81c-137e-46cd-a745-885bbe8f8b87 req-f5a0c1a5-8901-4450-80ea-cd98010ae49a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:25.539361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-bb28f81c-137e-46cd-a745-885bbe8f8b87 req-f5a0c1a5-8901-4450-80ea-cd98010ae49a service nova] Creating event network-vif-deleted:179ef3ed-c463-418f-b678-aaee7de5535e for instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 on hv-cinder-80152 Oct 05 20:26:25.548074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-bb28f81c-137e-46cd-a745-885bbe8f8b87 req-f5a0c1a5-8901-4450-80ea-cd98010ae49a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056342 Oct 05 20:26:25.553904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 335/660] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:25.935118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:25.936849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:25.950381 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:25.951321 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:25.954909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:25.956151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:25.958285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:25.959043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:26.054093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:26.054589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:26.055524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:26.056043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lazy-loading 'fault' on Instance uuid 1f20ad33-5d0e-4324-b1b5-c8f823457933 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:26.126134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:26.135792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:26.137319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:26.138523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f4f3e09b-65ec-4546-9edf-01b5c0843207 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 200 len: 1372 microversion: 2.20 time: 0.207841 Oct 05 20:26:26.139239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 326/661] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:25 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:26.341552 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:26.342948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:26.354483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:26.354990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:26.355422 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:26.358036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:26.363075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:26.363710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:26.665830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:26.685747 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f4901141-1990-46fe-9f81-b125d06198f4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1665 microversion: 2.1 time: 0.348687 Oct 05 20:26:26.690601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 336/662] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:26 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1665 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:27.164268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:27.165464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:27.172897 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:27.173231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:27.173747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:27.174570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:27.175141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:27.175570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:27.190148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] HTTP exception thrown: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Request method failure captured: Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 HTTP/1.1 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedkxH_NsdNSwvc5RM3B4vez13DF2iEJPc03yAp9Om7qarEp2P2GFMkPnzsIrkxDCkdW0UTAZRxMKxKNUs28NV5Vws9rYpjj72OReze3Xil3Iot1qmwv6oCVsAP20ZyznFoje8h4JMB8i1mN2PsFBhVUKqjraDkhS9Z38JJmSy6uJiI Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:26:27.191782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: ff9b14ab630d4a928614c60e6aea667c Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:26:27.193406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '1f20ad33-5d0e-4324-b1b5-c8f823457933'} Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:26:27.194193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:26:27.195349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:27.196362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Returning 404 to user: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:26:27.196362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2d2913f4-70eb-4294-b907-60a851862c76 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 404 len: 111 microversion: 2.20 time: 0.033128 Oct 05 20:26:27.196362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 327/663] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:27 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:26:27.203235 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e33ea736-3378-4a0d-8b6c-c4be927aba2e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '.version_select at 0x7f3e0265f940>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:27.232365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e33ea736-3378-4a0d-8b6c-c4be927aba2e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073248308" status: 204 len: 0 microversion: 2.20 time: 0.033416 Oct 05 20:26:27.237642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 337/664] 10.222.0.23 () {60 vars in 1262 bytes} [Wed Oct 5 20:26:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073248308 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 20:26:27.714079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:27.714888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:27.725273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:27.726169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:27.726763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:27.727642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:27.728108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:27.728536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:28.031716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:28.041448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-15372d03-779c-410c-8e57-1119085bf2ff tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1669 microversion: 2.1 time: 0.331177 Oct 05 20:26:28.063469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 328/665] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:27 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1669 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:28.154008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-57864ec0-23a8-4bd8-845b-beeb5ea5f963 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'create', calling method: .version_select at 0x7f3e0256eaf0>, body: {"keypair": {"name": "tempest-keypair-752461285", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDr/OqcqeQP1HSvzbSrcv74hkBQaTAeyi8hpHXo7NmkngqWc5MB6y8RVclqX3BmNkDiUT09GN7BD76lu9hpyRL/ZDvNiDOIb8BvPRo4BuNX/mfrAnt/6gJAXF571xSPaKA=="}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:28.161774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:28.177011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-57864ec0-23a8-4bd8-845b-beeb5ea5f963 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'key_pairs'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:26:28.183887 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-57864ec0-23a8-4bd8-845b-beeb5ea5f963 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for user ff9b14ab630d4a928614c60e6aea667c and project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'key_pairs'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:26:28.224991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-57864ec0-23a8-4bd8-845b-beeb5ea5f963 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.074857 Oct 05 20:26:28.234895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 338/666] 10.222.0.23 () {62 vars in 1200 bytes} [Wed Oct 5 20:26:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 20:26:30.075184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1878602368", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f57b2de0-9b37-423e-9981-d689d8abf0c3"}], "security_groups": [{"name": "tempest-securitygroup--112028687"}], "key_name": "tempest-keypair-752461285", "user_data": "}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:30.190093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] validate_networks() for [('f57b2de0-9b37-423e-9981-d689d8abf0c3', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:26:30.603959 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:26:30.604567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:26:30.605036 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:26:30.605622 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:26:30.606028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:26:30.616033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:30.616767 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:30.617370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:30.618134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:30.618593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:30.619022 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:30.636928 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:26:30.642117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Getting quotas for user ff9b14ab630d4a928614c60e6aea667c and project 140a5d8a1d264d8bad17d352591fa6a2. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:26:30.656215 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:26:30.658536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:26:30.711239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9c1fbab9-8cd1-42f5-ba64-cf0ca0ca910f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.639866 Oct 05 20:26:30.717602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 329/667] 10.222.0.23 () {62 vars in 1188 bytes} [Wed Oct 5 20:26:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 20:26:30.723164 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b209f3a8-d85e-4dfe-b53a-a6a2bdbef6bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:30.724279 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b209f3a8-d85e-4dfe-b53a-a6a2bdbef6bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:30.857088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b209f3a8-d85e-4dfe-b53a-a6a2bdbef6bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:30.872921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b209f3a8-d85e-4dfe-b53a-a6a2bdbef6bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:30.875740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b209f3a8-d85e-4dfe-b53a-a6a2bdbef6bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:30.877337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b209f3a8-d85e-4dfe-b53a-a6a2bdbef6bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1281 microversion: 2.20 time: 0.158143 Oct 05 20:26:30.879168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 339/668] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:30 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:31.876280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:31.877448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:31.884346 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:31.885057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:31.885677 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:31.886546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:31.887151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:31.887806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:31.903324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:31.903871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:31.915813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:31.916302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:31.916733 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:31.917431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:31.917905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:31.918317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:31.942615 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-00b318d0-eab1-4dea-acea-1039d832f5fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/ips" status: 200 len: 149 microversion: 2.1 time: 0.069603 Oct 05 20:26:31.950608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 330/669] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:26:31 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/ips => generated 149 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:31.956486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2103c4ab-0784-4c35-8f17-c851131697c0"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:31.959195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:31.965622 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:31.966405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:31.967363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:31.968893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:31.969748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:31.970382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:32.051691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:32.069172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Invalid volume: volume 2103c4ab-0784-4c35-8f17-c851131697c0 is already attached to instances: d4189131-495b-4d78-9eb7-b69ea29c7b50 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: POST /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/os-volume_attachments HTTP/1.1 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 74 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:26:32.071095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {"volumeAttachment": {"volumeId": "2103c4ab-0784-4c35-8f17-c851131697c0"}} Oct 05 20:26:32.072467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Invalid volume: volume 2103c4ab-0784-4c35-8f17-c851131697c0 is already attached to instances: d4189131-495b-4d78-9eb7-b69ea29c7b50 Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'server_id': '6bd5c8f4-254b-4924-a74a-8f5b8f190b48', 'body': {'volumeAttachment': {'volumeId': '2103c4ab-0784-4c35-8f17-c851131697c0'}}} Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2103c4ab-0784-4c35-8f17-c851131697c0 is already attached to instances: d4189131-495b-4d78-9eb7-b69ea29c7b50 Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:32.073354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2103c4ab-0784-4c35-8f17-c851131697c0 is already attached to instances: d4189131-495b-4d78-9eb7-b69ea29c7b50 Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:32.075284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:32.076599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:32.076599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:26:32.076599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:26:32.076599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2103c4ab-0784-4c35-8f17-c851131697c0 is already attached to instances: d4189131-495b-4d78-9eb7-b69ea29c7b50 Oct 05 20:26:32.076599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:32.076599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 400 to user: Invalid volume: volume 2103c4ab-0784-4c35-8f17-c851131697c0 is already attached to instances: d4189131-495b-4d78-9eb7-b69ea29c7b50 {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:26:32.077570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-86e24d42-ae9f-4ef6-b48b-c24874f41f29 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.125659 Oct 05 20:26:32.078934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 331/670] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:26:31 2022] POST /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48/os-volume_attachments => generated 174 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:26:32.086565 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:32.093033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:32.094042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:32.095270 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0a5db273-65aa-4d89-8d07-dad85153235c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1333 microversion: 2.20 time: 0.195869 Oct 05 20:26:32.096034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:32.113779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 340/671] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:31 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1333 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:26:32.116075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:32.116572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:32.117004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:32.117742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:32.119241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:32.119894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:32.146679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:26:32.242027 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b0bf8bec-b323-44a0-9e58-210af6c746fd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 204 len: 0 microversion: 2.1 time: 0.157661 Oct 05 20:26:32.242996 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 332/672] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:26:32 2022] DELETE /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:26:32.253046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:32.254025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:32.264337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:32.265043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:32.265613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:32.266457 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:32.267555 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:32.268154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:32.520731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:32.528924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-80bffed0-1021-486d-a4cb-618ed4809b3a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1680 microversion: 2.1 time: 0.281585 Oct 05 20:26:32.546874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 341/673] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:32 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1680 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:33.123574 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:33.124841 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:33.131532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:33.132015 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:33.132485 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:33.133763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:33.134220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:33.135249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:33.220436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:33.230251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:33.232556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:33.234685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-73122efd-8612-4f6f-bf92-6292ebdaddcc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1341 microversion: 2.20 time: 0.114790 Oct 05 20:26:33.249581 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 333/674] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:33 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1341 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:33.553012 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:33.553777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:33.569272 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:33.569816 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:33.570254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:33.570967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:33.571424 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:33.571844 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:33.826372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:33.859075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-78ce21ab-e943-4fc3-a247-13e3bd505c40 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1680 microversion: 2.1 time: 0.309732 Oct 05 20:26:33.860190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 342/675] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:33 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1680 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:34.261944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:34.262560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:34.280401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:34.284903 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:34.285730 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:34.286656 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:34.287275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:34.290691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:34.397616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:34.408839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:34.415503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:34.416896 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e8615a4d-3360-4af2-a67d-61abbc310c71 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1339 microversion: 2.20 time: 0.158872 Oct 05 20:26:34.420912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 334/676] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:34 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1339 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:34.887014 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:34.887718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:34.908138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:34.908981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:34.911167 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:34.913939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:34.915130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:34.916889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:35.449924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:35.451565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:35.462817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:35.463334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:35.463785 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:35.464525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:35.464995 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:35.465433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:35.471711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:35.602066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:35.612560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8e1fc399-5bb2-4ddd-88dc-326dbb1a2d65 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1680 microversion: 2.1 time: 0.729368 Oct 05 20:26:35.613729 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 343/677] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:34 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1680 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:35.790110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:35.807455 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:35.809190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:35.810448 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cef365e7-ee99-412e-8a01-ef2177f52c9e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.367148 Oct 05 20:26:35.811276 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 335/678] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:35 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:26:36.165155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-74847fb5-17b5-44c4-9c84-5610ddcb2755 req-920525c1-b4bd-48fa-a1d7-ebe631e1ed55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:36.194853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-74847fb5-17b5-44c4-9c84-5610ddcb2755 req-920525c1-b4bd-48fa-a1d7-ebe631e1ed55 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.195683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-74847fb5-17b5-44c4-9c84-5610ddcb2755 req-920525c1-b4bd-48fa-a1d7-ebe631e1ed55 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.203979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-74847fb5-17b5-44c4-9c84-5610ddcb2755 req-920525c1-b4bd-48fa-a1d7-ebe631e1ed55 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:36.217188 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-74847fb5-17b5-44c4-9c84-5610ddcb2755 req-920525c1-b4bd-48fa-a1d7-ebe631e1ed55 service nova] Creating event network-changed:938a7d9f-3a0f-4c79-80ef-ca3e36f0894f for instance 4afc70e1-0337-42dd-9976-27f07f9baff3 on hv-cinder-80152 Oct 05 20:26:36.223635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-74847fb5-17b5-44c4-9c84-5610ddcb2755 req-920525c1-b4bd-48fa-a1d7-ebe631e1ed55 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063293 Oct 05 20:26:36.225041 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 344/679] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:36.508573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-187598a8-a6b5-4eb4-bcf9-002b17f13939 req-a790036a-9eac-438c-aa59-fd0612766ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bd5c8f4-254b-4924-a74a-8f5b8f190b48", "name": "network-vif-deleted", "tag": "6bf325fe-56f6-427f-8567-d1c8aa923356"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:36.540601 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-187598a8-a6b5-4eb4-bcf9-002b17f13939 req-a790036a-9eac-438c-aa59-fd0612766ec5 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.541591 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-187598a8-a6b5-4eb4-bcf9-002b17f13939 req-a790036a-9eac-438c-aa59-fd0612766ec5 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.542217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-187598a8-a6b5-4eb4-bcf9-002b17f13939 req-a790036a-9eac-438c-aa59-fd0612766ec5 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:36.564332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-187598a8-a6b5-4eb4-bcf9-002b17f13939 req-a790036a-9eac-438c-aa59-fd0612766ec5 service nova] Creating event network-vif-deleted:6bf325fe-56f6-427f-8567-d1c8aa923356 for instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 on hv-cinder-80152 Oct 05 20:26:36.591968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-187598a8-a6b5-4eb4-bcf9-002b17f13939 req-a790036a-9eac-438c-aa59-fd0612766ec5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089679 Oct 05 20:26:36.598709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 336/680] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:36.647325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:36.649691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:36.669174 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.670485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.671505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:36.672445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.672868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.673298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:36.754780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.756779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.758105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:36.758614 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lazy-loading 'fault' on Instance uuid 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:36.845384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:36.846286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:36.853989 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.854709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.855426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:36.856319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:36.856926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:36.857501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:37.061566 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:37.074226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:37.075885 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:37.077229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a4e77dde-4bc2-4130-a26a-1e8d89d60fd4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.236758 Oct 05 20:26:37.081181 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 337/681] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:36 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:37.109249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:37.117395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-97fd1214-8a16-4183-ba04-9bfb7e86138a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1330 microversion: 2.1 time: 0.480859 Oct 05 20:26:37.133766 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 345/682] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:36 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1330 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:38.105872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:38.106590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:38.115315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:38.118446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:38.119005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:38.121780 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:38.122526 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:38.123286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:38.140970 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:38.143160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:38.150579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:38.151387 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:38.153778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:38.163345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:38.167718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:38.168380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:38.228676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:38.229324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:38.230075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:38.230623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lazy-loading 'fault' on Instance uuid 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:38.281461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:38.290367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7055faa6-7708-4f12-a29e-bfa73fc41618 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 200 len: 1330 microversion: 2.1 time: 0.153813 Oct 05 20:26:38.292678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 346/683] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:38 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 1330 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:38.333394 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:38.348369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:38.350097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:38.353157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8a152e13-84ab-4c45-9b8d-02259c96675c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.250926 Oct 05 20:26:38.399646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 338/684] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:38 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:39.320282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:39.320932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:39.329139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:39.329839 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:39.330423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:39.331329 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:39.331948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:39.332634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:39.352716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 HTTP/1.1 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:26:39.354871 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:26:39.356096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '6bd5c8f4-254b-4924-a74a-8f5b8f190b48'} Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:26:39.357745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:26:39.359563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:26:39.361809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:26:39.362803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2435871b-c1ca-4ee1-b356-7558fc8968a7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 404 len: 111 microversion: 2.1 time: 0.048361 Oct 05 20:26:39.363988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 347/685] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:39 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:26:39.374736 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a66400b4-f916-40f3-8aa2-2309d9c356e4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '.version_select at 0x7f3e0252dd30>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:39.400039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:39.403381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:39.416119 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:39.416611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:39.417054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:39.417774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:39.418226 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:39.418646 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:39.426864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a66400b4-f916-40f3-8aa2-2309d9c356e4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-761224161" status: 202 len: 0 microversion: 2.1 time: 0.058489 Oct 05 20:26:39.427778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 339/686] 10.222.0.23 () {58 vars in 1218 bytes} [Wed Oct 5 20:26:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-761224161 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:39.666796 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:39.676101 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:39.681621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:39.683138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7e08e7b3-9560-4e31-8c05-d4198e7b8c00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.295714 Oct 05 20:26:39.683717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 348/687] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:39 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:40.261800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:40.262285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:40.264195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:40.271309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:40.271791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:40.272222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:40.272919 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:40.273564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:40.274135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:40.363932 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lazy-loading 'services' on Instance uuid d4189131-495b-4d78-9eb7-b69ea29c7b50 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:40.445651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ee106e24-7a9f-45b6-91a4-17408fa9ccda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments/2103c4ab-0784-4c35-8f17-c851131697c0" status: 202 len: 0 microversion: 2.1 time: 0.187663 Oct 05 20:26:40.446327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 340/688] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:26:40 2022] DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments/2103c4ab-0784-4c35-8f17-c851131697c0 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:40.457275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:40.459529 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:40.466330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:40.466809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:40.467237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:40.468277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:40.468632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:40.469084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:40.508917 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e6d923cd-a17e-4dd4-b48c-d7d0029d4dcd tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056662 Oct 05 20:26:40.509495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 349/689] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:40 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:40.711723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:40.712485 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=6 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:40.719585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:40.720468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:40.736649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:40.737146 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:40.737612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:40.738447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:40.739072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:40.741490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:40.940594 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:40.951333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:40.953947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:40.955125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-71534b16-ee03-4a7b-86ae-be283e04aa5c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.244329 Oct 05 20:26:40.956091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 341/690] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:40 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:41.525462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:41.533111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:41.535718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:41.550621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:41.551508 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:41.552150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:41.553046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:41.553690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:41.554253 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:41.588934 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a60afb0b-113e-49a3-996c-e37e381941e3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065821 Oct 05 20:26:41.589494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 350/691] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:41 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:26:41.660490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:41.661565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:41.667946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:41.668429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:41.669046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:41.669849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:41.670452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:41.671066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:41.698056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:26:41.788946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-07df6a3e-a0c0-418d-a1fd-2a35d1981039 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 204 len: 0 microversion: 2.1 time: 0.131623 Oct 05 20:26:41.790366 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 342/692] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:26:41 2022] DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:26:41.799382 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:41.800170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:41.810388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:41.812721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:41.813391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:41.814721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:41.815386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:41.816008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:41.989404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:41.992331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:41.993230 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:41.999844 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-590850ff-58ac-4388-8eb2-347ad1b6d08d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1683 microversion: 2.1 time: 0.204869 Oct 05 20:26:42.000290 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:42.013707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 351/693] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:41 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:42.014427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:42.015647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:42.016547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:42.017008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:42.017431 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:42.487864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:42.496589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:42.498176 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:42.500157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6bfd4f8c-6608-45bb-9015-24c8a11a3cee tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.512131 Oct 05 20:26:42.500830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 343/694] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:41 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:43.027985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:43.029239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:43.037394 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:43.038286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:43.039445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:43.040338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:43.040995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:43.041596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:43.204712 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:43.215089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b4419262-35c2-444d-b3af-ef9198bdf04e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1683 microversion: 2.1 time: 0.191568 Oct 05 20:26:43.230143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 352/695] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:43 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:43.297228 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-48db24e8-1ac6-4dfa-9e7a-725b430cb081 req-d3341d64-e02e-4c24-98a1-590ac977a8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "name": "network-vif-plugged", "status": "completed", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:43.314350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-48db24e8-1ac6-4dfa-9e7a-725b430cb081 req-d3341d64-e02e-4c24-98a1-590ac977a8db service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:43.315132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-48db24e8-1ac6-4dfa-9e7a-725b430cb081 req-d3341d64-e02e-4c24-98a1-590ac977a8db service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:43.315559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-48db24e8-1ac6-4dfa-9e7a-725b430cb081 req-d3341d64-e02e-4c24-98a1-590ac977a8db service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:43.330287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-48db24e8-1ac6-4dfa-9e7a-725b430cb081 req-d3341d64-e02e-4c24-98a1-590ac977a8db service nova] Creating event network-vif-plugged:938a7d9f-3a0f-4c79-80ef-ca3e36f0894f for instance 4afc70e1-0337-42dd-9976-27f07f9baff3 on hv-cinder-80152 Oct 05 20:26:43.338367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-48db24e8-1ac6-4dfa-9e7a-725b430cb081 req-d3341d64-e02e-4c24-98a1-590ac977a8db service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045408 Oct 05 20:26:43.340160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 344/696] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:43.526376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:43.528064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:43.535232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:43.535792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:43.536454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:43.537357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:43.537853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:43.538273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:43.542455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:43.711964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:43.730955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:43.732482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:43.733702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f3466a27-32d6-4d3e-9a66-a6399877db2a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.211344 Oct 05 20:26:43.735420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 353/697] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:43 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:26:44.242325 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:44.243510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:44.250974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:44.251859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:44.252685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:44.253634 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:44.254444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:44.255082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:44.552791 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:44.563164 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8259f7c0-ef7f-42ae-967b-e43e2abb499e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1683 microversion: 2.1 time: 0.325035 Oct 05 20:26:44.578456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 345/698] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:44 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1683 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:44.765153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:44.765839 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:44.773609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:44.774623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:44.775411 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:44.776531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:44.777238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:44.777840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:45.050513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:45.060083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:45.061830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:45.065833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0ea6ecbb-e412-4169-8356-33a11f0ec19f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1406 microversion: 2.20 time: 0.305353 Oct 05 20:26:45.066750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 354/699] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:44 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1406 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:45.128506 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-b332a7fa-210d-4e7c-b8ef-fc2781bb8f2c req-3f3201b8-4685-401f-b8d9-98465c3c0d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4189131-495b-4d78-9eb7-b69ea29c7b50", "name": "network-vif-deleted", "tag": "ed1c8db8-3987-4cdb-be27-b92626517d7e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:45.143957 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-b332a7fa-210d-4e7c-b8ef-fc2781bb8f2c req-3f3201b8-4685-401f-b8d9-98465c3c0d9c service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:45.144720 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-b332a7fa-210d-4e7c-b8ef-fc2781bb8f2c req-3f3201b8-4685-401f-b8d9-98465c3c0d9c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:45.149814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-b332a7fa-210d-4e7c-b8ef-fc2781bb8f2c req-3f3201b8-4685-401f-b8d9-98465c3c0d9c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:45.169029 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-b332a7fa-210d-4e7c-b8ef-fc2781bb8f2c req-3f3201b8-4685-401f-b8d9-98465c3c0d9c service nova] Creating event network-vif-deleted:ed1c8db8-3987-4cdb-be27-b92626517d7e for instance d4189131-495b-4d78-9eb7-b69ea29c7b50 on hv-cinder-80152 Oct 05 20:26:45.175781 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-b332a7fa-210d-4e7c-b8ef-fc2781bb8f2c req-3f3201b8-4685-401f-b8d9-98465c3c0d9c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049838 Oct 05 20:26:45.178062 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 346/700] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:45.596560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:45.598440 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:45.613922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:45.614425 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:45.614920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:45.617705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:45.618175 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:45.618606 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:45.734171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:45.743059 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0a2a104d-9670-4aee-8c28-b5459b982a2a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 200 len: 1327 microversion: 2.1 time: 0.158633 Oct 05 20:26:45.743922 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 355/701] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:45 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:46.094106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:46.094666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:46.103011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:46.103427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:46.103867 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:46.104575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:46.105023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:46.105466 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:46.300440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:46.312497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:46.314086 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:46.315265 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d0d45c28-a1c1-49a1-bec7-963a81b0321a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1597 microversion: 2.20 time: 0.226841 Oct 05 20:26:46.315966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 347/702] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:26:46 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1597 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:26:46.348501 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:46.349313 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:46.363792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:46.365258 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:46.366328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:46.368115 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:46.372102 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:46.372861 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:46.508125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-679596b9-7741-4664-a2de-e4ea588586b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.163190 Oct 05 20:26:46.508828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 356/703] 10.222.0.23 () {60 vars in 1316 bytes} [Wed Oct 5 20:26:46 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-interface => generated 284 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:26:46.771517 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:46.772417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:46.782894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:46.783674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:46.784278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:46.785268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:46.785918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:46.786496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:46.805952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 HTTP/1.1 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:26:46.807675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:26:46.809238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'd4189131-495b-4d78-9eb7-b69ea29c7b50'} Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:26:46.810177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:26:46.811705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:26:46.812998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:26:46.812998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b88c7fb7-54e1-40d0-b3c2-ddf4b079c4b6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 404 len: 111 microversion: 2.1 time: 0.042429 Oct 05 20:26:46.818536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-720f95ad-5e90-4001-b212-ef9f961cc9a4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '.version_select at 0x7f3e05ebf790>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:46.821857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 348/704] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:46 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:26:46.840275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-720f95ad-5e90-4001-b212-ef9f961cc9a4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985780925" status: 202 len: 0 microversion: 2.1 time: 0.025749 Oct 05 20:26:46.844993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 357/705] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Oct 5 20:26:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1985780925 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:47.839869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1bf76f29-e048-4e1d-a0cd-2b6de417eb52 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: .version_select at 0x7f3e024bd5e0>, body: {"keypair": {"name": "tempest-keypair-1810865079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEgsgtuHvR+I4LNoUJxj4a3dwj6e9igVbLLIFcU7BHT1BQJZwp6QL7Hju/g1QclFYWtwbeZDFmDNg2+FS5/GA744LxB7SAg8M/U1g9XCJsXiFSLnSh6CZvI5h7y9ygcEhw=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:47.861400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-1bf76f29-e048-4e1d-a0cd-2b6de417eb52 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:26:47.867738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-1bf76f29-e048-4e1d-a0cd-2b6de417eb52 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:26:47.901454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1bf76f29-e048-4e1d-a0cd-2b6de417eb52 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065398 Oct 05 20:26:47.902546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 349/706] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:26:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:48.259795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-606dbe2b-9592-4f51-a12a-bc6a2e5713b2 req-69976956-5df7-439c-a2d4-2207c00de93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:48.273880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-606dbe2b-9592-4f51-a12a-bc6a2e5713b2 req-69976956-5df7-439c-a2d4-2207c00de93a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:48.274711 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-606dbe2b-9592-4f51-a12a-bc6a2e5713b2 req-69976956-5df7-439c-a2d4-2207c00de93a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:48.275142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-606dbe2b-9592-4f51-a12a-bc6a2e5713b2 req-69976956-5df7-439c-a2d4-2207c00de93a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:48.287448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-606dbe2b-9592-4f51-a12a-bc6a2e5713b2 req-69976956-5df7-439c-a2d4-2207c00de93a service nova] Creating event network-changed:938a7d9f-3a0f-4c79-80ef-ca3e36f0894f for instance 4afc70e1-0337-42dd-9976-27f07f9baff3 on hv-cinder-80152 Oct 05 20:26:48.292987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-606dbe2b-9592-4f51-a12a-bc6a2e5713b2 req-69976956-5df7-439c-a2d4-2207c00de93a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037421 Oct 05 20:26:48.294367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 358/707] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:26:48.403065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d8a84d64-d70a-4ace-8b95-79b4323fb5df tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Action: 'create', calling method: .version_select at 0x7f3e024c1dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1678459228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaU2aWh6ihiGRUUky0AgOIeSJ0JOjgGIPaMrHhytu0TSXSELlDWXBJBIVHV7injU5cYiVS/5L9pQ4Di9eGNqxs8hUYpXC/pVG+wMG+hTi1EepyY+i2vdqt5EMq70BrVZw=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:48.421880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-d8a84d64-d70a-4ace-8b95-79b4323fb5df tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Getting quotas for project 5d5f5bc40cdc4be792aff778d3020c6d. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:26:48.427129 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-d8a84d64-d70a-4ace-8b95-79b4323fb5df tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Getting quotas for user 5500db61c95f4245945784ae6b13f197 and project 5d5f5bc40cdc4be792aff778d3020c6d. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:26:48.457382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d8a84d64-d70a-4ace-8b95-79b4323fb5df tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.057541 Oct 05 20:26:48.459562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 350/708] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:26:48 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:48.516647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-346766565", "imageRef": "4f5d73e6-3668-44f1-b884-926a11aa9c14", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1678459228", "networks": [{"uuid": "e2ff507a-5556-4eeb-8338-0d9f9e3dbc81"}]}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:48.581743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] validate_networks() for [('e2ff507a-5556-4eeb-8338-0d9f9e3dbc81', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:26:49.150766 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:26:49.151665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:26:49.152258 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:26:49.152799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:26:49.153537 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:26:49.162767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:49.163558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:49.164163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:49.165082 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:49.165554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:49.166122 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:49.183880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Getting quotas for project 5d5f5bc40cdc4be792aff778d3020c6d. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:26:49.189011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Getting quotas for user 5500db61c95f4245945784ae6b13f197 and project 5d5f5bc40cdc4be792aff778d3020c6d. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:26:49.206264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:26:49.208598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4f5d73e6-3668-44f1-b884-926a11aa9c14',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:26:49.260275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-500e6e41-474f-4bb0-83ed-48add3e5d814 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749781 Oct 05 20:26:49.261683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 359/709] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:26:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:26:49.272514 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e85303e3-32a2-49c6-96cf-388af20ff86d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:49.273175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e85303e3-32a2-49c6-96cf-388af20ff86d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:49.336593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e85303e3-32a2-49c6-96cf-388af20ff86d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:49.345775 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e85303e3-32a2-49c6-96cf-388af20ff86d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1258 microversion: 2.1 time: 0.076545 Oct 05 20:26:49.346367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 351/710] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:49 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:49.953785 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-748760006", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b866581-0156-4c8b-8621-7be5c67dfe5d"}], "security_groups": [{"name": "tempest-securitygroup--644984736"}], "key_name": "tempest-keypair-1810865079", "user_data": "}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:26:50.079388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] validate_networks() for [('9b866581-0156-4c8b-8621-7be5c67dfe5d', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:26:50.367969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:50.368490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:50.375268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:50.375749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:50.376178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:50.376866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:50.377313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:50.377759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:50.441470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:50.449829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1574dced-ae55-4fbc-9612-012b91809699 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1310 microversion: 2.1 time: 0.085123 Oct 05 20:26:50.449931 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 352/711] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:50 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1310 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:50.454484 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:26:50.454976 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:26:50.455523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:26:50.456038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:26:50.456520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:26:50.465431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:50.465948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:50.466385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:50.467112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:50.467597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:50.468022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:50.485978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:26:50.489964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:26:50.501536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:26:50.503768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:26:50.555681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7bd196fb-b02f-498b-9223-9414d15fe53f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.606420 Oct 05 20:26:50.556340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 360/712] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:26:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:26:50.568870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-98039a06-bfee-4148-88fe-0ddc17b1969d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:50.569564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-98039a06-bfee-4148-88fe-0ddc17b1969d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:50.673234 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-98039a06-bfee-4148-88fe-0ddc17b1969d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:50.681192 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-98039a06-bfee-4148-88fe-0ddc17b1969d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1241 microversion: 2.1 time: 0.117072 Oct 05 20:26:50.682198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 353/713] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:50 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1241 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:51.048572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:51.049073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:51.063343 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.064375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.065009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.065949 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.066575 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.067439 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.207506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'services' on Instance uuid 200392c4-aaf6-477e-a61a-45cf68f9b765 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:26:51.333441 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c190c49b-c824-48f3-96ae-20d14adf62a7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments/441aeb36-a020-447a-901e-c21aa03edf43" status: 202 len: 0 microversion: 2.1 time: 0.290177 Oct 05 20:26:51.334341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 361/714] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:26:51 2022] DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments/441aeb36-a020-447a-901e-c21aa03edf43 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:26:51.345057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:51.348031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:51.361538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.362613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.363486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.365009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.366384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.367276 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.429631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2d7bb4a9-1387-4925-b975-02f005c59e00 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089237 Oct 05 20:26:51.438056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 354/715] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:51 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:51.472978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:51.473795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:51.493418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.493945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.494391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.495105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.495561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.496193 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.671968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:51.680030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c9c265b5-aced-4619-bb7d-01f25659d39f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.211348 Oct 05 20:26:51.680812 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 362/716] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:51 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:51.704987 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:51.705558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:51.711777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.712578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.713170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.714110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:51.714710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:51.715303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:51.810449 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:51.820025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-11c71993-cc36-43e9-b1e8-9775e939fdfa tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.119407 Oct 05 20:26:51.820701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 355/717] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:51 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:52.443795 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:52.446136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:52.448600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:52.453969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:52.454458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:52.454891 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:52.455613 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:52.456098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:52.456525 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:52.486322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ac9256ed-0661-4a64-8130-f81069010382 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046829 Oct 05 20:26:52.486913 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 363/718] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:52 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:52.708378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:52.709119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:52.716174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:52.716666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:52.717173 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:52.718064 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:52.718672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:52.719274 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:52.850628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:52.851775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:52.862879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:52.863705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:52.864338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:52.865703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:52.867214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:52.868005 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:52.897950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:52.911281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1f804816-f0b5-43d7-ac13-001fb9b6c493 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.210948 Oct 05 20:26:52.912783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 356/719] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:52 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:52.968708 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:52.976396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c3ba49e8-40e9-4035-9cc4-5083048a2060 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.132943 Oct 05 20:26:52.976951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 364/720] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:52 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:53.499823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:53.502294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:53.508509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:53.509002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:53.510216 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:53.510941 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:53.511541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:53.511975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:53.515619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:53.553723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cd746a72-7d3b-4a1a-b64a-6c3c8a7594f7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058504 Oct 05 20:26:53.559726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 357/721] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:53 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:53.935552 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:53.936400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:53.943252 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:53.943815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:53.944372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:53.945137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:53.945847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:53.946271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:53.999525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:54.000149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:54.006676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:54.007159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:54.007593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:54.008295 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:54.008746 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:54.009190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:54.069499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:54.077557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:54.077731 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-08dd8322-7257-4d57-a2d4-afa7f0e0004b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.082364 Oct 05 20:26:54.078161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 358/722] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:53 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:54.085602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-426eea1a-92f6-44bf-9971-eaa477edb8e6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.154507 Oct 05 20:26:54.086240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 365/723] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:53 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:54.671265 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:54.673482 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:54.679395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:54.679871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:54.680303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:54.680989 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:54.681439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:54.681886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:54.727015 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1ef1a693-d170-4b42-9d8f-4e501732c12a tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162517 Oct 05 20:26:54.727889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 359/724] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:54 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:55.100130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:55.100736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:55.107289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:55.107843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:55.108537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:55.108921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:55.109177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:55.109493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:55.109966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:55.110385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:55.115763 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:55.116456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:55.116961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:55.117695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:55.118150 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:55.118576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:55.190347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:55.200549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dd5c8cd2-30a8-4341-8b60-c99bde2f2c92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.104155 Oct 05 20:26:55.202581 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 366/725] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:55 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:55.279009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:55.286979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b0973009-600a-4b37-bfd5-e8c0829a254c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.182782 Oct 05 20:26:55.287552 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 360/726] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:55 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:55.739793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:55.741968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:55.747929 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:55.748920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:55.749352 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:55.750083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:55.750537 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:55.750960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:55.779809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-484bcb09-b8ed-47f6-9f86-0a3f04d22d89 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Oct 05 20:26:55.780358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 367/727] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:55 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:56.225249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:56.225912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:56.234252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:56.234832 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:56.235258 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:56.236157 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:56.236772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:56.237198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:56.310054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:56.310692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:56.317676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:56.318096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:56.318769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:56.319368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:56.320220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:56.320829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:56.321409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:56.348858 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bc76433e-f6e0-494c-8e16-a8aeae074e12 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.127027 Oct 05 20:26:56.356398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 361/728] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:56 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:56.496873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:56.505722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d9d3b28c-392f-452b-9f3c-11921159d110 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.199387 Oct 05 20:26:56.506551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 368/729] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:56 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:26:56.793050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:56.796179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:56.804914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:56.804914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:56.804914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:56.804914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:56.805570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:56.806148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:56.860151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ec47edfa-f83e-41b7-a2f3-dae2254eec54 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071691 Oct 05 20:26:56.861086 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 362/730] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:56 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:57.379249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:57.379973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:57.386325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:57.386808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:57.387239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:57.387924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:57.388380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:57.388801 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:57.450769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:57.458566 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-38f60c0a-628e-473d-82fa-c0e513d908fc tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.083259 Oct 05 20:26:57.459128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 369/731] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:57 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:57.529201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:57.529952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:57.536219 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:57.536691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:57.537120 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:57.537850 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:57.538297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:57.538716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:57.691163 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:57.699455 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-459a8825-e0c1-4a87-ab3e-4a9cba4755bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.174055 Oct 05 20:26:57.700224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 363/732] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:57 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:57.872285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:57.874998 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:57.880901 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:57.881378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:57.881874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:57.882563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:57.883013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:57.883434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:57.912445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0104ca63-c46b-44d0-a63e-a1f15491e351 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Oct 05 20:26:57.912926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 370/733] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:57 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:58.481286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:58.481925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:58.488558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:58.489042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:58.489475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:58.490188 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:58.490641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:58.491063 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:58.551297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:58.558830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cf40e079-1383-402b-8d9e-adc2d9b62d48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.081508 Oct 05 20:26:58.559391 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 364/734] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:58 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:58.723940 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:58.724560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:58.731133 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:58.731623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:58.732061 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:58.733312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:58.733804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:58.734263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:58.875664 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:58.885960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6eed856a-2093-41cd-bfd5-9c29c3494cfd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.165750 Oct 05 20:26:58.887209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 371/735] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:58 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:58.926859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:58.929425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:58.936364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:58.936853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:58.937287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:58.938042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:58.938495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:58.938922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:58.968242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-01837f73-0dea-4345-b99c-619382895a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047101 Oct 05 20:26:58.968804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 365/736] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:58 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:26:59.582206 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:59.582745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:59.589123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:59.589637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:59.590168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:59.590856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:59.591304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:59.591720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:59.610754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:26:59.658286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:26:59.666227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-02f9d61c-b1bd-4b16-bb41-efe4337664d8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.087846 Oct 05 20:26:59.666975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 372/737] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:59 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:26:59.909861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:59.910475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:59.917145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:59.917663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:59.918101 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:59.918787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:59.919236 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:59.919655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:59.980358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:26:59.982548 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:26:59.989281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:59.989790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:59.990218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:26:59.990901 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:26:59.991346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:26:59.991761 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:00.022246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d5aee139-4473-42ce-b59b-5d2a65a96812 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045852 Oct 05 20:27:00.022819 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 373/738] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:26:59 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:00.054632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:00.066565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-af2faa4a-eb38-4c48-b417-579d930242ce tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.159667 Oct 05 20:27:00.068421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 366/739] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:26:59 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:00.692778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:00.693391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:00.695249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=4 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:00.695914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=12 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:00.701486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:00.701993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:00.702428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:00.703118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:00.703567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:00.703990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:00.766059 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:00.774818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-49856530-772b-4e5f-85aa-ddb404e52227 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.086069 Oct 05 20:27:00.775388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 374/740] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:00 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:01.034857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:01.036975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:01.039017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=12 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:01.044612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:01.045160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:01.045627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:01.046313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:01.046762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:01.047182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:01.080206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-422a330b-5fd1-4d4e-a3f7-4a78f4e8e59f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049264 Oct 05 20:27:01.080774 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 367/741] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:01 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:01.095559 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:01.096172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:01.103107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:01.103594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:01.104056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:01.104748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:01.105201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:01.105650 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:01.263102 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:01.270811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0cbf997e-2a2a-405d-bf32-33b8c90e6a22 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.179653 Oct 05 20:27:01.271380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 375/742] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:01 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:01.798916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:01.799602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:01.805908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:01.806399 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:01.806893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:01.807553 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:01.808012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:01.808441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:01.870320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:01.878781 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-33e85491-5f30-494d-8e26-eee16d36744d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.084256 Oct 05 20:27:01.879363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 368/743] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:01 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:02.093021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:02.095257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:02.101709 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:02.102310 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:02.102610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:02.103297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:02.103749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:02.104171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:02.132753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7b32fedd-f061-4bcd-a1a5-9cafc77e8ca4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Oct 05 20:27:02.133301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 376/744] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:02 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:02.293200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:02.293834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:02.300559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:02.301064 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:02.301489 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:02.302217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:02.302916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:02.303565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:02.434033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:02.441527 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6789cdd4-96f8-4a7f-86f6-707ed3d04a1b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.152261 Oct 05 20:27:02.442360 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 369/745] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:02 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:02.902319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:02.902927 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:02.909017 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:02.909542 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:02.909989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:02.910701 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:02.911149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:02.911598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:02.972576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:02.980024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9c98b632-ac0b-4f31-a3b1-b3d18e7943ae tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1237 microversion: 2.1 time: 0.081569 Oct 05 20:27:02.980578 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 377/746] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:02 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:03.144936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:03.147095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:03.153039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.153536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.153978 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.154668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.155121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.155545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.183305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c0d45586-7c56-4572-8fca-0e8007c33c02 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Oct 05 20:27:03.183851 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 370/747] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:03 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:03.464046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:03.464645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:03.471299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.471771 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.472200 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.472888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.473336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.473778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.584320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:03.586534 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:03.593337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.594247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.594905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.595812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.596484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.597012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.660106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-190f1e22-485c-494a-aeb4-d42a2f12fffd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079495 Oct 05 20:27:03.662255 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 371/748] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:03 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 20:27:03.709776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:03.735554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1af31e10-e13f-48f2-8577-1244cf628fc8 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.275283 Oct 05 20:27:03.738697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:03.739442 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:03.745297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.745866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.746305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.747006 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.747463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.747886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.750315 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 378/749] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:03 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:03.773385 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:27:03.806386 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:03.842573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:03.849293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9e300dfb-304b-41d3-ab74-4b96976abafa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 204 len: 0 microversion: 2.1 time: 0.114298 Oct 05 20:27:03.850095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 372/750] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:27:03 2022] DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 20:27:03.858804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:03.859418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:03.865868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.866478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.867040 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:03.867979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:03.868540 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:03.869064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.004779 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:04.005488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:04.008593 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:04.012812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.013307 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.014313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.015189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.015809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.016236 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.019503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-50314240-6b55-455d-b887-4c97dc1ca8f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1675 microversion: 2.1 time: 0.165046 Oct 05 20:27:04.020476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 379/751] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:03 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:04.095502 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:04.105407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9803740d-dca3-4b2b-86a3-43c5bf91e1c4 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1293 microversion: 2.1 time: 0.105018 Oct 05 20:27:04.106138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 373/752] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:03 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:04.195904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:04.198254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:04.205292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.205888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.206454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.207212 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.207738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.208305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.215367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-771f8292-796b-414f-864d-5ef83647a50f req-ee7136b9-b668-4a7a-945f-d22141294d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:04.225279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-771f8292-796b-414f-864d-5ef83647a50f req-ee7136b9-b668-4a7a-945f-d22141294d5f service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.225796 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-771f8292-796b-414f-864d-5ef83647a50f req-ee7136b9-b668-4a7a-945f-d22141294d5f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.226227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-771f8292-796b-414f-864d-5ef83647a50f req-ee7136b9-b668-4a7a-945f-d22141294d5f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.237535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-771f8292-796b-414f-864d-5ef83647a50f req-ee7136b9-b668-4a7a-945f-d22141294d5f service nova] Creating event network-changed:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:27:04.240258 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-810f9552-59bc-4234-b245-1dcead3f1a64 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048773 Oct 05 20:27:04.245377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 380/753] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:04 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:04.245562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-771f8292-796b-414f-864d-5ef83647a50f req-ee7136b9-b668-4a7a-945f-d22141294d5f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030507 Oct 05 20:27:04.245562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 374/754] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:04.759702 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:04.760314 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:04.767357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.767840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.768274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.768973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:04.769425 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:04.769966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:04.896216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:04.903841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-abbd67c8-387c-44b8-aedf-5d8f62aba705 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.148070 Oct 05 20:27:04.904406 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 381/755] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:04 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:05.130043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:05.130651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:05.136473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.136995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.137385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.138117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.138596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.139536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.142703 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:05.143430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:05.149650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.150130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.150560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.151349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.151796 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.152217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.200856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:05.208869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7b4d16b7-5295-4f2f-ace6-0c54e593982f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1293 microversion: 2.1 time: 0.082597 Oct 05 20:27:05.209431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 382/756] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:05 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:05.252868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:05.255063 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:05.260971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.261456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.261913 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.262600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.263045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.263459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.288066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:05.293364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bcc6c9a7-beae-4e3b-9910-4f1973ae034c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Oct 05 20:27:05.293959 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 383/757] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:05 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:05.296473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d9d6208d-3178-4d6e-bd9e-cf77acd0b262 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1675 microversion: 2.1 time: 0.256971 Oct 05 20:27:05.297187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 375/758] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:05 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:05.928001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:05.928649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:05.935022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.935509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.935950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:05.936640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:05.937687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:05.938114 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.093917 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:06.101439 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8431fb83-ac9f-42ba-bd38-c945340bdbfa tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.178523 Oct 05 20:27:06.102030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 384/759] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:05 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:06.231863 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:06.232504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:06.238979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:06.239461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:06.239895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.240583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:06.241039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:06.241463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.307099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:06.308981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:06.309284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:06.320344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b0b67468-5bc1-45ae-b590-c7147bf3c3ac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1293 microversion: 2.1 time: 0.092131 Oct 05 20:27:06.320829 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 376/760] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:06 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:06.327205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:06.331095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:06.332245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:06.334225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:06.335674 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.338284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:06.338425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:06.338857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:06.339219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:06.339327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.339890 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.340007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:06.340687 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:06.341123 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:06.379821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d8aad184-cff3-4179-abbd-79142338e6a0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077088 Oct 05 20:27:06.380749 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 385/761] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:06 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:06.519036 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:06.526771 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-43d4f3d7-c881-4c88-aa80-a6943d4a6f2c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1675 microversion: 2.1 time: 0.204997 Oct 05 20:27:06.527354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 377/762] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:06 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:07.125286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:07.125969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:07.132242 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.132950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.133434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.134260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.134865 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.135427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.348509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:07.349154 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:07.356586 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.358206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.358823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.359543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.359992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.360425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.434088 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:07.443877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f91d7f2b-46fd-44f4-9c47-4ae9aae78de8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1299 microversion: 2.1 time: 0.100297 Oct 05 20:27:07.444703 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 378/763] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:07 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:07.461603 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:07.464083 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:07.474924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.475731 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.477421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.478489 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.479045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.480393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.522644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-06d8103a-53ca-49b6-8674-d94adc8572c4 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070544 Oct 05 20:27:07.523557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 379/764] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:27:07 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:27:07.570068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:07.575563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:07.599535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.600039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.600481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.601199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.601704 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.602136 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.718583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:07.726268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8bbb5463-bd41-4ecc-bdaa-e08f2c90f009 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1608 microversion: 2.1 time: 0.171015 Oct 05 20:27:07.727220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 380/765] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:07 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:07.732362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:07.732507 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:07.738590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.739164 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.739613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.740416 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.740853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.744628 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.768549 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:27:07.805227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:07.813105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-cbf76b0d-4bf8-4ef7-bb10-63c5d911883c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.692615 Oct 05 20:27:07.813731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 386/766] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:07 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:07.865708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-747ac2f8-42c8-4691-924c-245a6e880d0c tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 204 len: 0 microversion: 2.1 time: 0.137129 Oct 05 20:27:07.866665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 381/767] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:27:07 2022] DELETE /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:27:07.875841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:07.876618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:07.883058 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.883658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.884185 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:07.884989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:07.904739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:07.907916 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.063126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-061e393c-ae65-433d-bc07-cab8fc6ac135 req-940293eb-3e8c-4b35-9013-8b26b340a151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc97e634-82d8-4433-bee0-6d00f84075e7", "name": "network-vif-deleted", "tag": "0b7637cb-b026-4f28-9263-f8fb7d10f2e2"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:08.074010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-061e393c-ae65-433d-bc07-cab8fc6ac135 req-940293eb-3e8c-4b35-9013-8b26b340a151 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.074845 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-061e393c-ae65-433d-bc07-cab8fc6ac135 req-940293eb-3e8c-4b35-9013-8b26b340a151 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.075942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-061e393c-ae65-433d-bc07-cab8fc6ac135 req-940293eb-3e8c-4b35-9013-8b26b340a151 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.091118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-061e393c-ae65-433d-bc07-cab8fc6ac135 req-940293eb-3e8c-4b35-9013-8b26b340a151 service nova] Creating event network-vif-deleted:0b7637cb-b026-4f28-9263-f8fb7d10f2e2 for instance cc97e634-82d8-4433-bee0-6d00f84075e7 on hv-cinder-80152 Oct 05 20:27:08.097580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-061e393c-ae65-433d-bc07-cab8fc6ac135 req-940293eb-3e8c-4b35-9013-8b26b340a151 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038861 Oct 05 20:27:08.098979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 382/768] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:08.160567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:08.168304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0044d9b2-863d-4fda-9b1a-7a77f6042eb0 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1688 microversion: 2.1 time: 0.297692 Oct 05 20:27:08.168864 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 387/769] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:07 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1688 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:08.471294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:08.471990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:08.478057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.478531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.478961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.479651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.480096 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.480516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.611191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:08.619380 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f529a294-3b54-4db1-98ef-2430157d13a6 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.153497 Oct 05 20:27:08.619943 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 383/770] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:08 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:08.752436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:08.753052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:08.759220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.759719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.760160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.760854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.761490 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.761946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.824598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:08.833144 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-07f037f8-08ef-4eda-b483-2922797dddfe tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1608 microversion: 2.1 time: 0.084625 Oct 05 20:27:08.833962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 388/771] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:08 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1608 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:08.837421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:08.838111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:08.845001 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.845782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.846426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.847294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:08.847905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:08.848485 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:08.984525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:08.992242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-85b0c371-6e90-4993-863b-ebe0ebb68822 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.158643 Oct 05 20:27:08.992805 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 384/772] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:08 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:09.192951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:09.193488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:09.199898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:09.200386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:09.200816 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:09.201498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:09.201963 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:09.202522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:09.206999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=100 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:09.332316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:09.339995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-400be083-2171-4692-a8d2-0030bf47db05 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1688 microversion: 2.1 time: 0.151350 Oct 05 20:27:09.340568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 389/773] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:09 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:09.643369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:09.644177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:09.651011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:09.651495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:09.651933 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:09.652625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:09.653078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:09.653501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:09.777579 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:09.785158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ff5bd7b6-d214-4fad-88db-4fbafc587f78 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.146297 Oct 05 20:27:09.785678 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 385/774] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:09 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:09.856988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:09.857663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:09.863647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:09.864250 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:09.864692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:09.865373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:09.865846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:09.866265 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:09.926720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:09.934202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f9aafc52-48d6-4deb-ab87-7136eb072fdd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1608 microversion: 2.1 time: 0.080979 Oct 05 20:27:09.934761 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 390/775] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:09 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1608 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:10.015854 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:10.016473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:10.022304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.022779 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.023208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.023887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.024336 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.024752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.147071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:10.154519 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7e645335-c15e-4d48-b9b8-bc2a4f8a4dbe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.143122 Oct 05 20:27:10.155091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 386/776] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:10 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:10.363465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:10.364004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:10.370530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.371008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.371436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.372145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.372590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.373003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.500734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:10.508397 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-903950f1-db0b-409f-8441-14bb83a653ad tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1688 microversion: 2.1 time: 0.148849 Oct 05 20:27:10.508964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 391/777] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:10 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1688 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:10.806989 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:10.807599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:10.814452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.814935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.815370 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.816062 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.816514 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.816937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.949674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:10.957927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1b800e89-cbb8-4439-bae4-eb4eb80841d7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.154678 Oct 05 20:27:10.958693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 387/778] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:10 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:10.958862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:10.959477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:10.966259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.966751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.967188 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:10.967883 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:10.968898 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:10.969325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.034635 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:11.042346 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3444614e-791c-4436-9969-dcbc78d99469 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1608 microversion: 2.1 time: 0.087279 Oct 05 20:27:11.042907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 392/779] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:10 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1608 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:11.177787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:11.178397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:11.184139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.184600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.185034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.185749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.186199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.186612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.201688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:11.425298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:11.433126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-652adf68-49ca-43da-bea0-756aa674952e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.259535 Oct 05 20:27:11.433737 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 388/780] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:11 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:11.532583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:11.533228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:11.539376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.539803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.540233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.540926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.541409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.541852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.683626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:11.692669 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9c419ca0-d306-4991-8c76-a8b84e1e8da6 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1688 microversion: 2.1 time: 0.164264 Oct 05 20:27:11.693257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 393/781] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:11 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:11.969479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-51ed38b2-bdc0-4545-a8b0-6a3d3543091b req-7d1b1391-de55-44ad-9171-afc67d27b157 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26f72d3-ab1b-472f-9551-b044693c2168", "tag": "21c37543-10a5-4609-9753-10ac54200c0e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:11.979699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-51ed38b2-bdc0-4545-a8b0-6a3d3543091b req-7d1b1391-de55-44ad-9171-afc67d27b157 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.980177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-51ed38b2-bdc0-4545-a8b0-6a3d3543091b req-7d1b1391-de55-44ad-9171-afc67d27b157 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.980797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-51ed38b2-bdc0-4545-a8b0-6a3d3543091b req-7d1b1391-de55-44ad-9171-afc67d27b157 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.981942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:11.982636 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:11.989570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.990532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.990954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.991846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:11.992312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:11.992883 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:11.994175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-51ed38b2-bdc0-4545-a8b0-6a3d3543091b req-7d1b1391-de55-44ad-9171-afc67d27b157 service nova] Creating event network-changed:21c37543-10a5-4609-9753-10ac54200c0e for instance c26f72d3-ab1b-472f-9551-b044693c2168 on hv-cinder-80152 Oct 05 20:27:11.999411 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-51ed38b2-bdc0-4545-a8b0-6a3d3543091b req-7d1b1391-de55-44ad-9171-afc67d27b157 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033935 Oct 05 20:27:12.001664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 389/782] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:12.067029 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:12.067908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:12.074041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.074526 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.074955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.075641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.076099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.076517 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.107060 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.107542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.107979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.108419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lazy-loading 'fault' on Instance uuid cc97e634-82d8-4433-bee0-6d00f84075e7 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:12.123589 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:12.131451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-63b8dc89-fb8f-486e-807c-83a13fabb6f0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.153539 Oct 05 20:27:12.132117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 394/783] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:11 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:12.149145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:12.157324 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-47e73868-4143-4a39-ace6-696b72227f95 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1328 microversion: 2.1 time: 0.094571 Oct 05 20:27:12.157918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 390/784] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:12 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1328 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:12.456641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:12.457257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:12.463192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.463678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.464112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.464809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.465260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.465710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.612800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:12.620809 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8976dadd-d4d1-4f69-a719-41e10ff7e9fc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.168510 Oct 05 20:27:12.621858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 395/785] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:12 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:12.717203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:12.717869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:12.729236 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.730190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.730782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.731819 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:12.732596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:12.733289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:12.960596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:12.971073 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1d9b4995-603a-49e9-a74e-0300082e8671 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1688 microversion: 2.1 time: 0.258620 Oct 05 20:27:12.972275 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 391/786] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:12 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1688 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:13.153787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:13.154360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:13.160350 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.160842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.161284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.162012 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.162476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.162906 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.181407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:13.182280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:13.189641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.190293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.190843 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.191696 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.192643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.193172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.227016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.227610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.228068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.228647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lazy-loading 'fault' on Instance uuid cc97e634-82d8-4433-bee0-6d00f84075e7 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:13.309723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:13.336521 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7e6c617a-c146-41e8-97d0-178c47d1c30f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 200 len: 1328 microversion: 2.1 time: 0.158853 Oct 05 20:27:13.342304 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 392/787] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:13 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 1328 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:13.449305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:13.461621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b8040d01-c8f0-4bb2-bc71-33ec5471f232 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.311702 Oct 05 20:27:13.464723 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 396/788] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:13 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:13.644889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:13.645688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:13.651927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.652498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.653004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.653810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:13.654327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:13.654835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:13.789824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:13.798076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-59f72ed5-de1d-4b4b-b61c-6f092a2e16be tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.158227 Oct 05 20:27:13.798649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 393/789] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:13 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:13.995103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:13.995718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:14.002544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.003113 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.004032 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.004388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.004908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.005474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.013895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-e896dd8e-678f-4977-9aab-9bb7a2dbd27b req-272d76a5-4bd7-4230-a434-8764af5bf628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200392c4-aaf6-477e-a61a-45cf68f9b765", "name": "network-vif-deleted", "tag": "1c54cda3-3ed7-4392-b95f-fb3527c84492"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:14.024065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-e896dd8e-678f-4977-9aab-9bb7a2dbd27b req-272d76a5-4bd7-4230-a434-8764af5bf628 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.024560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-e896dd8e-678f-4977-9aab-9bb7a2dbd27b req-272d76a5-4bd7-4230-a434-8764af5bf628 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.024990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-e896dd8e-678f-4977-9aab-9bb7a2dbd27b req-272d76a5-4bd7-4230-a434-8764af5bf628 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.037573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-e896dd8e-678f-4977-9aab-9bb7a2dbd27b req-272d76a5-4bd7-4230-a434-8764af5bf628 service nova] Creating event network-vif-deleted:1c54cda3-3ed7-4392-b95f-fb3527c84492 for instance 200392c4-aaf6-477e-a61a-45cf68f9b765 on hv-cinder-80152 Oct 05 20:27:14.039135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.039620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.040056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.040500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'fault' on Instance uuid 200392c4-aaf6-477e-a61a-45cf68f9b765 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:14.043468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-e896dd8e-678f-4977-9aab-9bb7a2dbd27b req-272d76a5-4bd7-4230-a434-8764af5bf628 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033509 Oct 05 20:27:14.044071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 394/790] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:14.082752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:14.090670 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-aab5012d-7030-46d6-b053-6127e1320c5f tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 200 len: 1335 microversion: 2.1 time: 0.099380 Oct 05 20:27:14.091364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 397/791] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:13 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:14.361741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:14.362445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:14.369531 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.370062 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.370496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.371199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.371651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.372073 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.385536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] HTTP exception thrown: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Request method failure captured: Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 HTTP/1.1 Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedqc1aiTUHgQhoq2Sfwv85nae1gd3kVyBf1O4mNx0ReHfQghHh90lXo6KjQn04u7yu1UgtxJp5UjNajKtVA_GbdsJtGlmKHXvYfBs3CztRyWghO3E3O3a777evDid6YhCWEY_Hp2jU53VP-y7NdxdKIJ9XfulaWncFdtUYfeamsaPw Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:27:14.387200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: c28866ff5b2a4dd4ba05270b369f064e Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:27:14.388828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'cc97e634-82d8-4433-bee0-6d00f84075e7'} Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:27:14.390131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:27:14.391649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:14.393007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Returning 404 to user: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:27:14.393007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-269ec5c1-c4a5-45eb-a226-678a8d26d246 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 404 len: 111 microversion: 2.1 time: 0.032207 Oct 05 20:27:14.393007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 395/792] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:14 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:27:14.397755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-67428599-ebee-4a4e-bcff-8c7adcc7e283 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '.version_select at 0x7f3e0256ef70>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:14.416445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-67428599-ebee-4a4e-bcff-8c7adcc7e283 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994082307" status: 202 len: 0 microversion: 2.1 time: 0.022719 Oct 05 20:27:14.417009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 398/793] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Oct 5 20:27:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1994082307 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:27:14.490833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:14.491785 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:14.497592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.498079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.498510 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.499749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.500406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.500839 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.651170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:14.658965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d101c7a8-ab41-48ef-b485-277209e32eeb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.172087 Oct 05 20:27:14.659524 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 396/794] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:14 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:14.820529 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:14.821131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:14.827081 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.828057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.828488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:14.829168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:14.829633 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:14.830050 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:15.004690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:15.013935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0d70a0ad-cca1-40c2-905d-174504aa8a7c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.197498 Oct 05 20:27:15.015857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 399/795] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:14 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:15.115221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:15.116251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: 200392c4-aaf6-477e-a61a-45cf68f9b765] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:15.122509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:15.123106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:15.124393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:15.125165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:15.125716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:15.126262 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:15.141450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] HTTP exception thrown: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 could not be found. Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Request method failure captured: Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 HTTP/1.1 Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedipfPsghRxxr8JlXcA2OmTImyDJvKLT3ZxMSlNAaUg5XrSN9-akXCc_X8qyP0_ov5Kj8oFZRZM2CHjBRJRku916eEt1KspjId-ZunLkvqg2zi9a4bevsPaQ5xOs0KdcCUV4-Hd_9jKawtqrxpUAdLhl_ELaEi3U0IRlhNl4hufYdg Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:27:15.143070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07f868da50254a68bc692bca433d2699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07f868da50254a68bc692bca433d2699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 1301a78c1a684c94acb9f26b56f39f21 Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 could not be found. Oct 05 20:27:15.144632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '200392c4-aaf6-477e-a61a-45cf68f9b765'} Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 could not be found. Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:27:15.145476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 could not be found. Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 could not be found. Oct 05 20:27:15.150743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:15.152320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Returning 404 to user: Instance 200392c4-aaf6-477e-a61a-45cf68f9b765 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:27:15.152320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5cb95209-d0b9-4281-8a75-d91f1d4875c3 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765" status: 404 len: 111 microversion: 2.1 time: 0.033954 Oct 05 20:27:15.152320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 397/796] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:15 2022] GET /compute/v2.1/servers/200392c4-aaf6-477e-a61a-45cf68f9b765 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:27:15.153617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2bf278ba-3a00-4394-b29b-425eae7845e2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '.version_select at 0x7f3e026ae8b0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:15.173433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-17f5342a-d696-4ab0-a89d-ac38199c7c87 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: .version_select at 0x7f3e024bdd30>, body: {"keypair": {"name": "tempest-keypair-1090456404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhVGyjtnyzXRYBCUKBuSI1a/NbV0/2N4sh+t+gZYTo5QJaquV8m+YSm/7BZJpIL4PZsT5PH0pV5mbas1ghhSfrGk80SqnrXxaqmHOM7a7QtuefIYyT//LtzvBsMaANfYg=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:15.183127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2bf278ba-3a00-4394-b29b-425eae7845e2 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061647176" status: 202 len: 0 microversion: 2.1 time: 0.033229 Oct 05 20:27:15.184299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 400/797] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Oct 5 20:27:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061647176 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:27:15.193162 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-17f5342a-d696-4ab0-a89d-ac38199c7c87 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:27:15.197199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-17f5342a-d696-4ab0-a89d-ac38199c7c87 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for user c28866ff5b2a4dd4ba05270b369f064e and project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:27:15.222716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-17f5342a-d696-4ab0-a89d-ac38199c7c87 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053615 Oct 05 20:27:15.223505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 398/798] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:27:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:15.682522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:15.683469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:15.691583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:15.692759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:15.693355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:15.694755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:15.695362 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:15.695938 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:15.849996 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:15.858557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f23263b0-32f6-47bd-92fc-dcccf5b60fee tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.179965 Oct 05 20:27:15.859277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 401/799] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:15 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:16.039520 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:16.040318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:16.048355 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:16.048869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:16.049288 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:16.050035 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:16.050495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:16.050958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:16.266075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:16.274184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0eb082d2-55f8-41b7-b3d5-2c8454c21061 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.240007 Oct 05 20:27:16.274840 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 399/800] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:16 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:16.669078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1389625651", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "befb067e-a787-4f3b-9756-b797371b0a4e"}], "security_groups": [{"name": "tempest-securitygroup--309626032"}], "key_name": "tempest-keypair-1090456404", "user_data": "}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:16.774518 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] validate_networks() for [('befb067e-a787-4f3b-9756-b797371b0a4e', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:27:16.882413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:16.882939 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:16.889065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:16.889578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:16.890031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:16.890735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:16.891198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:16.891627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:17.028020 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:17.036172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9f9b3b5d-7d3b-4018-9401-674f7f40c716 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.157668 Oct 05 20:27:17.036742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 400/801] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:16 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:17.204024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:27:17.204441 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:27:17.205104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:27:17.205618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:27:17.205964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:27:17.216339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:17.216995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:17.217637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:17.218869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:17.219332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:17.219760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:17.237793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:27:17.241741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Getting quotas for user c28866ff5b2a4dd4ba05270b369f064e and project 45fc2abd2bae4264b1081c1673e3095e. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:27:17.252752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:27:17.255083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:27:17.275444 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:17.300821 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:17.302226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:17.305991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-24717d00-7869-4637-b0e2-2256b8cc6349 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641052 Oct 05 20:27:17.307015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 402/802] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:27:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:27:17.309880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:17.310446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:17.310957 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:17.311772 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:17.312315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:17.312910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:17.320085 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-17650d3d-d65a-4f36-a81b-98f79239faa9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:17.320806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-17650d3d-d65a-4f36-a81b-98f79239faa9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:17.397173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-17650d3d-d65a-4f36-a81b-98f79239faa9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:17.406013 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-17650d3d-d65a-4f36-a81b-98f79239faa9 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1238 microversion: 2.1 time: 0.091189 Oct 05 20:27:17.406532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 403/803] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:17 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:17.490782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:17.500986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7c51de69-92d0-4a8f-abb5-f2f6ed5c03fe tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.204721 Oct 05 20:27:17.502194 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 401/804] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:17 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:17.576549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-211a1848-87fe-4dbf-ae3d-4b2efb5124f9 req-70d29959-6726-45d3-8e6b-6285785b5512 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "name": "network-vif-plugged", "status": "completed", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:17.590622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-211a1848-87fe-4dbf-ae3d-4b2efb5124f9 req-70d29959-6726-45d3-8e6b-6285785b5512 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:17.600033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-211a1848-87fe-4dbf-ae3d-4b2efb5124f9 req-70d29959-6726-45d3-8e6b-6285785b5512 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:17.600619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-211a1848-87fe-4dbf-ae3d-4b2efb5124f9 req-70d29959-6726-45d3-8e6b-6285785b5512 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:17.614535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-211a1848-87fe-4dbf-ae3d-4b2efb5124f9 req-70d29959-6726-45d3-8e6b-6285785b5512 service nova] Creating event network-vif-plugged:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:27:17.619742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-211a1848-87fe-4dbf-ae3d-4b2efb5124f9 req-70d29959-6726-45d3-8e6b-6285785b5512 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047038 Oct 05 20:27:17.620842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 404/805] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:18.058818 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:18.059435 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:18.065901 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.066382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.066817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.067760 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.068211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.068636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.193329 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:18.201075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9421ee97-4d36-408b-82e8-8471f7dea1ab tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.146116 Oct 05 20:27:18.201668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 402/806] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:18 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:18.248182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:18.248772 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:18.255550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.256228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.256664 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.257360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.257841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.258266 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.285004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:27:18.360528 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4f93a2c8-6c70-49fd-a9c3-8c0ac7d89f66 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 204 len: 0 microversion: 2.1 time: 0.116897 Oct 05 20:27:18.361097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 405/807] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:27:18 2022] DELETE /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:27:18.368925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:18.369558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:18.376105 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.376585 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.377023 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.377749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.378207 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.378685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.430226 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:18.431035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:18.437654 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.438214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.438719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.439503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.440027 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.440520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.504056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:18.511988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-276fcbc2-540f-4a06-b88e-e5fbddd25ae5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1234 microversion: 2.1 time: 0.085967 Oct 05 20:27:18.513431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 406/808] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:18 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1234 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:18.515205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:18.523429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3f237073-cecd-4806-a764-5dc06b1f3823 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1507 microversion: 2.1 time: 0.158242 Oct 05 20:27:18.523991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 403/809] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:18 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:18.533474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:18.533474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:18.533474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.533474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.533888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.533888 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:18.534318 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:18.534734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:18.660928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:18.670479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-90fe0fe5-c22b-49a6-b113-d5c7c006785b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.148851 Oct 05 20:27:18.671853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 407/810] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:18 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:19.226047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:19.226664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:19.232476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.232950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.233938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.234633 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.235085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.235517 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.365666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:19.373199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bdbaecb4-ced4-4383-a508-a90777b373a3 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.151027 Oct 05 20:27:19.373789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 404/811] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:19 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:19.535913 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:19.536517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:19.543292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.543779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.544214 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.544907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.545396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.545851 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.546387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:19.547004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:19.550057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:19.554350 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.554837 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.555278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.555981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.556437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.556869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.614720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:19.622324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9323aaff-b508-4d80-b9b0-98e24726e60a tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1290 microversion: 2.1 time: 0.090304 Oct 05 20:27:19.623043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 408/812] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:19 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:19.641618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-8046422d-e547-425a-9481-101c730da26d req-4b79dfa9-92ce-47fa-87f4-c18321cc6fd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26f72d3-ab1b-472f-9551-b044693c2168", "name": "network-vif-plugged", "status": "completed", "tag": "21c37543-10a5-4609-9753-10ac54200c0e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:19.652642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-8046422d-e547-425a-9481-101c730da26d req-4b79dfa9-92ce-47fa-87f4-c18321cc6fd1 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.653128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-8046422d-e547-425a-9481-101c730da26d req-4b79dfa9-92ce-47fa-87f4-c18321cc6fd1 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.653594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-8046422d-e547-425a-9481-101c730da26d req-4b79dfa9-92ce-47fa-87f4-c18321cc6fd1 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.665157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-8046422d-e547-425a-9481-101c730da26d req-4b79dfa9-92ce-47fa-87f4-c18321cc6fd1 service nova] Creating event network-vif-plugged:21c37543-10a5-4609-9753-10ac54200c0e for instance c26f72d3-ab1b-472f-9551-b044693c2168 on hv-cinder-80152 Oct 05 20:27:19.670018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-8046422d-e547-425a-9481-101c730da26d req-4b79dfa9-92ce-47fa-87f4-c18321cc6fd1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032024 Oct 05 20:27:19.670621 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 409/813] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:19.696211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:19.696391 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:19.697043 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:19.703840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.704446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.704658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a714f79a-2efa-43f7-acf1-7eaac759e721 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1507 microversion: 2.1 time: 0.162186 Oct 05 20:27:19.705136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.705242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 405/814] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:19 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:19.705866 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:19.706324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:19.706746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:19.836470 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:19.844172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4a1375f9-0ba8-4c53-85f5-09cae90e4dbc tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.152737 Oct 05 20:27:19.844924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 410/815] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:19 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:20.396568 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:20.397171 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:20.403005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.403479 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.403912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.404590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.405038 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.405495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.530572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:20.538184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5b548e1b-60e7-4626-8b06-5eab502751cb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.145472 Oct 05 20:27:20.538750 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 406/816] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:20 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:20.645364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:20.646054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:20.652896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.653327 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.653811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.654527 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.654986 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.655403 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.716012 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:20.723433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a7ace341-b971-49a8-a06f-865d73bed0f2 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1290 microversion: 2.1 time: 0.082100 Oct 05 20:27:20.723995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 411/817] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:20 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:20.726966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:20.727679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:20.734436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.734913 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.735374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.736058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.736497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.736908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.867748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:20.876154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:20.876776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:20.877556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a85da88c-bbcf-4e9c-a649-bf4fda0d99bf tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1507 microversion: 2.1 time: 0.154635 Oct 05 20:27:20.878784 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 407/818] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:20 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:20.888575 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.889078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.890053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:20.890778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:20.891224 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:20.891651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:21.033348 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:21.041064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-aa6c774d-c069-4b3c-ba8f-f77a193b7763 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1358 microversion: 2.1 time: 0.174903 Oct 05 20:27:21.041655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 412/819] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:20 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:21.560203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:21.560815 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:21.567652 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:21.568135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:21.568570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:21.569268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:21.569748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:21.570175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:21.574174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:21.696167 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:21.704070 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-29a04fc6-5c81-4955-b3ac-a148eb0b9436 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.147749 Oct 05 20:27:21.704825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 408/820] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:21 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:21.747280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:21.748331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:21.754466 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:21.754952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:21.755385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:21.756071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:21.756665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:21.757166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:21.842053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:21.851610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3040c1b0-f3b5-4009-add8-4b9fc2605b2f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1290 microversion: 2.1 time: 0.108276 Oct 05 20:27:21.856467 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 413/821] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:21 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1290 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:21.901735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:21.902439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:21.908740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:21.909299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:21.909869 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:21.910634 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:21.911155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:21.911652 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.064278 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:22.064878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:22.071004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.071494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.071936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.072632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.073086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.073541 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.113709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.121488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3ec80cd2-7780-4f76-afe3-135e088019d7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1507 microversion: 2.1 time: 0.223588 Oct 05 20:27:22.122354 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 409/822] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:21 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1507 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:22.208363 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.216197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7c570fbb-ddc0-4025-8938-cd2603bf86ea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1549 microversion: 2.1 time: 0.156332 Oct 05 20:27:22.216768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 414/823] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:22 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:22.240966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:22.247056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:22.256144 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.256636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.257074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.257816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.258268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.258907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.356172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-6eaaeb6e-ff8c-4534-a9e9-d615f7784292 req-270c33dd-d61d-4865-8aa2-718ef64c1375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb4e1864-19fb-435d-ac75-675b0bf645c4", "name": "network-vif-deleted", "tag": "29d8ca08-27f5-4d47-969a-f9e88617fde0"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:22.367073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-6eaaeb6e-ff8c-4534-a9e9-d615f7784292 req-270c33dd-d61d-4865-8aa2-718ef64c1375 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.367498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-6eaaeb6e-ff8c-4534-a9e9-d615f7784292 req-270c33dd-d61d-4865-8aa2-718ef64c1375 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.368108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-6eaaeb6e-ff8c-4534-a9e9-d615f7784292 req-270c33dd-d61d-4865-8aa2-718ef64c1375 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.380193 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-6eaaeb6e-ff8c-4534-a9e9-d615f7784292 req-270c33dd-d61d-4865-8aa2-718ef64c1375 service nova] Creating event network-vif-deleted:29d8ca08-27f5-4d47-969a-f9e88617fde0 for instance fb4e1864-19fb-435d-ac75-675b0bf645c4 on hv-cinder-80152 Oct 05 20:27:22.385354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-6eaaeb6e-ff8c-4534-a9e9-d615f7784292 req-270c33dd-d61d-4865-8aa2-718ef64c1375 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097664 Oct 05 20:27:22.386742 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 415/824] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:22.404290 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.412929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-637b70e7-4001-4b5f-b06a-627dd024d69b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1549 microversion: 2.1 time: 0.176044 Oct 05 20:27:22.413500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 410/825] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:22 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1549 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:22.436308 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:22.443322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.444198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Searching by: {'deleted': False, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d'} {{(pid=120351) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 20:27:22.450872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.451354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.451791 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.452579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.453039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.453464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.547266 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.multi_cell_list [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120351) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 20:27:22.726882 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:22.728267 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:22.735103 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.735613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.736051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.737117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.737610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.738065 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.804775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8a60124e-7e66-4a02-ba73-41b5387cb372 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.372735 Oct 05 20:27:22.805761 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 416/826] 10.222.0.23 () {58 vars in 1125 bytes} [Wed Oct 5 20:27:22 2022] GET /compute/v2.1/servers => generated 342 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:22.817969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:22.818700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:22.827991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.828751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.829419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.830201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.830660 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.831085 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.882241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.890666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-164a6a25-cbb3-42dd-b4a8-062fdc5911ff tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1366 microversion: 2.1 time: 0.167998 Oct 05 20:27:22.893099 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 411/827] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:22 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:22.897930 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:22.898621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:22.901437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:22.905616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.906174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.906719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.907489 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:22.909385 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:22.909938 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:22.985484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.991946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:22.994425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-584b59ce-ab7c-4c77-a7ee-25949e52d6ac tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1290 microversion: 2.1 time: 0.100019 Oct 05 20:27:22.995225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 412/828] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:22 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1290 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:23.006993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-44525722-9955-43c1-bae2-69faca6505d4 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1549 microversion: 2.1 time: 0.193277 Oct 05 20:27:23.007987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 417/829] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:22 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:23.145151 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:23.146786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:23.156205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:23.156946 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:23.157477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:23.158512 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:23.159090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:23.159542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:23.193185 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:23.193705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:23.194334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:23.194788 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'fault' on Instance uuid fb4e1864-19fb-435d-ac75-675b0bf645c4 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:23.245002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:23.253737 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ad54cc55-fe52-4303-906f-30810b3122a9 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1312 microversion: 2.1 time: 0.112735 Oct 05 20:27:23.254392 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 413/830] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:23 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:23.920048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:23.921290 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:23.927688 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:23.928168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:23.928633 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:23.929321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:23.929792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:23.930213 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.018890 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:24.019986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:24.031141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.032327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.033468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.034397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.036569 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.037063 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.067596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:24.075448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1d7e6cbf-00dc-418e-b664-e21fb080f34b tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1556 microversion: 2.1 time: 0.160306 Oct 05 20:27:24.076017 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 418/831] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:23 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:24.098250 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:24.098737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:24.104587 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.105069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.105502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.106243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.106693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.107113 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.117844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:24.128672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-097de749-6c50-443e-ad4e-58e04140d3fb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1296 microversion: 2.1 time: 0.115165 Oct 05 20:27:24.129457 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 414/832] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:24 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1296 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:24.187042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a9c3f19c-223a-4520-a3e6-1ca2cdfdada0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092083 Oct 05 20:27:24.187645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 419/833] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:27:24 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:24.280792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:24.281452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:24.287672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.288453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.288885 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.289882 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.290506 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.291178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.335137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.336225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.336655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.337294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'fault' on Instance uuid fb4e1864-19fb-435d-ac75-675b0bf645c4 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:24.478983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:24.480172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:24.490853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.491622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.492209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.493154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.493808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.494597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.556945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-39f14c30-92ca-4f37-b351-5f14b69b9582 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/ips" status: 200 len: 150 microversion: 2.20 time: 0.274175 Oct 05 20:27:24.558969 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 420/834] 10.222.0.23 () {60 vars in 1289 bytes} [Wed Oct 5 20:27:24 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/ips => generated 150 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:27:24.660635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:24.671951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-17c78ec2-54d1-434d-b6d5-775c5d8721b5 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 200 len: 1312 microversion: 2.1 time: 0.397141 Oct 05 20:27:24.689077 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 415/835] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:24 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 1312 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:24.721376 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b0d118-27fe-4a0c-96b6-41bc971851fe"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:24.735843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:24.754893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.756854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.757476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:24.761142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:24.761957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:24.762400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.153195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:25.153825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:25.171362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.171866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.172303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.173020 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.173579 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.174592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.198132 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ff226b4c-cad3-4c01-bf30-272eb8f407af tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482956 Oct 05 20:27:25.200541 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 421/836] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:27:24 2022] POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:25.204758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=4 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:25.468191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:25.477072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b2d1385a-e9b6-4dc9-87bc-f1979c02af12 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.327645 Oct 05 20:27:25.477828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 416/837] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:25 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:25.631475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-1a5c2f5f-ee8b-443a-9a29-bd362d4ca4dc req-9538fcf6-ec76-4535-a92e-8e053fe8670c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e31a6c-f85c-451e-83f9-0e8ed25b885a", "tag": "3078e672-706f-44df-af9c-a4de3b8cc302"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:25.645644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1a5c2f5f-ee8b-443a-9a29-bd362d4ca4dc req-9538fcf6-ec76-4535-a92e-8e053fe8670c service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.646522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1a5c2f5f-ee8b-443a-9a29-bd362d4ca4dc req-9538fcf6-ec76-4535-a92e-8e053fe8670c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.647107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-1a5c2f5f-ee8b-443a-9a29-bd362d4ca4dc req-9538fcf6-ec76-4535-a92e-8e053fe8670c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.661390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-1a5c2f5f-ee8b-443a-9a29-bd362d4ca4dc req-9538fcf6-ec76-4535-a92e-8e053fe8670c service nova] Creating event network-changed:3078e672-706f-44df-af9c-a4de3b8cc302 for instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a on hv-cinder-80152 Oct 05 20:27:25.668009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-1a5c2f5f-ee8b-443a-9a29-bd362d4ca4dc req-9538fcf6-ec76-4535-a92e-8e053fe8670c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042506 Oct 05 20:27:25.669154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 422/838] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:25.694597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:25.695213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: fb4e1864-19fb-435d-ac75-675b0bf645c4] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:25.701351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.701833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.702953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.704323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.704954 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.705382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.720272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] HTTP exception thrown: Instance fb4e1864-19fb-435d-ac75-675b0bf645c4 could not be found. Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Request method failure captured: Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 HTTP/1.1 Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedipfPsghRxxr8JlXcA2OmTImyDJvKLT3ZxMSlNAaUg5XrSN9-akXCc_X8qyP0_ov5Kj8oFZRZM2CHjBRJRku916eEt1KspjId-ZunLkvqg2zi9a4bevsPaQ5xOs0KdcCUV4-Hd_9jKawtqrxpUAdLhl_ELaEi3U0IRlhNl4hufYdg Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:27:25.722287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07f868da50254a68bc692bca433d2699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07f868da50254a68bc692bca433d2699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 1301a78c1a684c94acb9f26b56f39f21 Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance fb4e1864-19fb-435d-ac75-675b0bf645c4 could not be found. Oct 05 20:27:25.723787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'fb4e1864-19fb-435d-ac75-675b0bf645c4'} Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb4e1864-19fb-435d-ac75-675b0bf645c4 could not be found. Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:27:25.724643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb4e1864-19fb-435d-ac75-675b0bf645c4 could not be found. Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb4e1864-19fb-435d-ac75-675b0bf645c4 could not be found. Oct 05 20:27:25.726061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:25.728189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Returning 404 to user: Instance fb4e1864-19fb-435d-ac75-675b0bf645c4 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:27:25.729192 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f76f52ea-467c-4df2-84bf-d96de29531df tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4" status: 404 len: 111 microversion: 2.1 time: 0.038858 Oct 05 20:27:25.729945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 417/839] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:25 2022] GET /compute/v2.1/servers/fb4e1864-19fb-435d-ac75-675b0bf645c4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:27:25.740143 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:25.741049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:25.751064 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.752521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.753186 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.754296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.755101 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.756458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.787637 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:27:25.821072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-1b3f412e-23a7-4059-b824-91b5b594c435 req-828fc66d-5670-4257-a3fb-680b3988064c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c26f72d3-ab1b-472f-9551-b044693c2168", "tag": "21c37543-10a5-4609-9753-10ac54200c0e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:25.832867 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1b3f412e-23a7-4059-b824-91b5b594c435 req-828fc66d-5670-4257-a3fb-680b3988064c service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.833436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1b3f412e-23a7-4059-b824-91b5b594c435 req-828fc66d-5670-4257-a3fb-680b3988064c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.834322 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1b3f412e-23a7-4059-b824-91b5b594c435 req-828fc66d-5670-4257-a3fb-680b3988064c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.848866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-1b3f412e-23a7-4059-b824-91b5b594c435 req-828fc66d-5670-4257-a3fb-680b3988064c service nova] Creating event network-changed:21c37543-10a5-4609-9753-10ac54200c0e for instance c26f72d3-ab1b-472f-9551-b044693c2168 on hv-cinder-80152 Oct 05 20:27:25.855188 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-1b3f412e-23a7-4059-b824-91b5b594c435 req-828fc66d-5670-4257-a3fb-680b3988064c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103388 Oct 05 20:27:25.856007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 418/840] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:25.886330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8f02a592-7141-4af3-b1db-8cec1494680d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "DELETE /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 204 len: 0 microversion: 2.1 time: 0.150824 Oct 05 20:27:25.887364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 423/841] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:27:25 2022] DELETE /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:27:25.897335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:25.898395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:25.904674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.905854 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.906382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:25.907278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:25.907756 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:25.908160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:26.057863 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:26.066454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-547a92d0-1814-480b-9815-08aebb65b9e7 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.173860 Oct 05 20:27:26.066998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 419/842] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:25 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:26.501889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:26.502592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:26.508934 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:26.509419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:26.509887 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:26.510574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:26.511030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:26.511454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:26.517610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:26.651418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:26.659466 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2d4f4963-e65d-4a02-9d6b-01347d9e3dc4 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.162502 Oct 05 20:27:26.660307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 424/843] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:26 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:27.089470 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:27.090110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:27.097299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.097950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.098400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.099093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.099547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.099972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.194562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:27.195181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:27.201401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.201946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.202381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.203069 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.203521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.203943 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.226979 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lazy-loading 'flavor' on Instance uuid 4afc70e1-0337-42dd-9976-27f07f9baff3 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:27.227620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:27.236647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-33c6f252-2db6-4000-88cd-92af53acfb96 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.151044 Oct 05 20:27:27.237224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 420/844] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:27 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:27.404353 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=8 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:27.425692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-15108fbf-b98f-4b19-ad62-573b373908f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/action" status: 202 len: 0 microversion: 2.20 time: 0.235204 Oct 05 20:27:27.426338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 425/845] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Oct 5 20:27:27 2022] POST /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 20:27:27.434316 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:27.434923 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:27.441384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.441907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.442597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.443284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.443739 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.444158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.569806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:27.577827 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:27.579277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:27.580424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f2d7827c-0f1d-4370-92b8-e1bcaf391551 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.149952 Oct 05 20:27:27.580986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 421/846] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:27 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:27.683964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:27.684624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:27.692534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.693016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.693462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.694149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:27.694596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:27.695014 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:27.822919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:27.830618 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fd80d9d7-8190-4609-9e77-fb581617a7fa tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.151556 Oct 05 20:27:27.831183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 426/847] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:27 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:28.260728 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:28.261341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:28.267843 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:28.268326 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:28.268766 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:28.269461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:28.269939 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:28.270389 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:28.407384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:28.415351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-16484230-4e97-4cd7-a88c-3d09899c4c20 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1520 microversion: 2.1 time: 0.158484 Oct 05 20:27:28.416110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 422/848] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:28 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:28.605602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:28.606217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:28.612981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:28.613466 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:28.613931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:28.614620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:28.615074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:28.615498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:28.854468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:28.855090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:28.860959 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:28.861446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:28.862336 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:28.863046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:28.863504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:28.863935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:28.864048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:28.872648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:28.874152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:28.875325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0904f71f-bfb2-467a-8a34-74894f8a1055 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.273670 Oct 05 20:27:28.877731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 427/849] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:28 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:28.995557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:29.003155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b433ae84-0b0f-493c-be65-8dd95c913d74 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.152612 Oct 05 20:27:29.003710 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 423/850] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:28 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:29.456578 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:29.457275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:29.475964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:29.476449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:29.476878 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:29.477596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:29.478055 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:29.478477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:29.507422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-22329ee7-ea02-4d1e-b81b-449bbfcf03c0 req-b60b6f6d-3726-4039-ad0b-8382a46ab900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4856b5d-d049-4ee8-9b69-ba630f8d128f", "name": "network-vif-deleted", "tag": "d4537d2a-eb74-46f9-a32b-750a8bc9692c"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:29.519998 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-22329ee7-ea02-4d1e-b81b-449bbfcf03c0 req-b60b6f6d-3726-4039-ad0b-8382a46ab900 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:29.520475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-22329ee7-ea02-4d1e-b81b-449bbfcf03c0 req-b60b6f6d-3726-4039-ad0b-8382a46ab900 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:29.521082 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-22329ee7-ea02-4d1e-b81b-449bbfcf03c0 req-b60b6f6d-3726-4039-ad0b-8382a46ab900 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:29.532797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-22329ee7-ea02-4d1e-b81b-449bbfcf03c0 req-b60b6f6d-3726-4039-ad0b-8382a46ab900 service nova] Creating event network-vif-deleted:d4537d2a-eb74-46f9-a32b-750a8bc9692c for instance f4856b5d-d049-4ee8-9b69-ba630f8d128f on hv-cinder-80152 Oct 05 20:27:29.537806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-22329ee7-ea02-4d1e-b81b-449bbfcf03c0 req-b60b6f6d-3726-4039-ad0b-8382a46ab900 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035850 Oct 05 20:27:29.538398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 424/851] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:29.557232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:29.565030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6a4f2a8f-715c-4556-a249-25552dfa7a29 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1478 microversion: 2.1 time: 0.129884 Oct 05 20:27:29.565608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 428/852] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:29 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1478 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:29.903980 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:29.904670 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:29.911409 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:29.911881 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:29.912309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:29.912988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:29.913432 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:29.913872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.026548 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:30.027153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:30.033606 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.034094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.034529 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.035222 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.035673 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.036094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.048182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:30.056252 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:30.057714 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:30.058860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6e022a7f-5845-4464-8c68-f8e616740144 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.159267 Oct 05 20:27:30.059429 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 425/853] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:29 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:30.164302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:30.172487 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bffe5f88-b416-46f4-a314-6015de9c1aa0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.149851 Oct 05 20:27:30.173052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 429/854] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:30 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:30.588259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:30.589476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:30.597130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.598107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.598753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.599467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.599922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.600349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.604730 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:30.636570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.637136 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.637868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.638543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lazy-loading 'fault' on Instance uuid f4856b5d-d049-4ee8-9b69-ba630f8d128f {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:27:30.687353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1301a78c1a684c94acb9f26b56f39f21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07f868da50254a68bc692bca433d2699', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:30.695187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dae02a1c-5a6e-474e-af50-a9a878688d2d tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 200 len: 1311 microversion: 2.1 time: 0.110728 Oct 05 20:27:30.695770 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 426/855] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:30 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:30.753398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:30.754036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:30.759887 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.760368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.760797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.761525 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:30.761980 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:30.762395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:30.900914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:30.909118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f77cb919-c1f3-4006-a965-4453cea360e5 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1595 microversion: 2.1 time: 0.159600 Oct 05 20:27:30.909718 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 430/856] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:30 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1595 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:31.087132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:31.088118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:31.097994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:31.099173 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:31.100241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:31.101185 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:31.101896 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:31.102558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:31.197306 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:31.198089 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:31.206776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:31.207508 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:31.207952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:31.208657 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:31.209156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:31.209632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:31.340880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:31.350368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:31.352042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:31.353407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-33d83f5a-d33e-4ac3-a5d3-97b63870f9dc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.270797 Oct 05 20:27:31.354211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 427/857] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:31 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:31.370936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:31.379423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c66e4cac-248c-490b-8f44-abb7ec560e52 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.188033 Oct 05 20:27:31.379991 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 431/858] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:31 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:31.717724 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:31.718279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] [instance: f4856b5d-d049-4ee8-9b69-ba630f8d128f] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:31.724460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:31.724937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:31.725369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:31.726087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:31.726536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:31.726983 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:31.740213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] HTTP exception thrown: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f could not be found. Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Request method failure captured: Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f HTTP/1.1 Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedipfPsghRxxr8JlXcA2OmTImyDJvKLT3ZxMSlNAaUg5XrSN9-akXCc_X8qyP0_ov5Kj8oFZRZM2CHjBRJRku916eEt1KspjId-ZunLkvqg2zi9a4bevsPaQ5xOs0KdcCUV4-Hd_9jKawtqrxpUAdLhl_ELaEi3U0IRlhNl4hufYdg Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:27:31.741875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_07f868da50254a68bc692bca433d2699"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/07f868da50254a68bc692bca433d2699"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/07f868da50254a68bc692bca433d2699"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 07f868da50254a68bc692bca433d2699 Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-88743331 Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 1301a78c1a684c94acb9f26b56f39f21 Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-ServerRescueNegativeTestJSON-88743331-project Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f could not be found. Oct 05 20:27:31.743259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'f4856b5d-d049-4ee8-9b69-ba630f8d128f'} Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f could not be found. Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:27:31.744002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f could not be found. Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f could not be found. Oct 05 20:27:31.745300 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:31.746461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] Returning 404 to user: Instance f4856b5d-d049-4ee8-9b69-ba630f8d128f could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:27:31.746461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-42f9fe8c-fc75-473f-be6c-f3575dbbe358 tempest-ServerRescueNegativeTestJSON-88743331 tempest-ServerRescueNegativeTestJSON-88743331-project] 10.222.0.23 "GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f" status: 404 len: 111 microversion: 2.1 time: 0.029548 Oct 05 20:27:31.746461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 428/859] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:31 2022] GET /compute/v2.1/servers/f4856b5d-d049-4ee8-9b69-ba630f8d128f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:27:32.379154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:32.379746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:32.387138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:32.387632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:32.388071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:32.388770 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:32.389258 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:32.389783 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:32.402707 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:32.403769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:32.413221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:32.414505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:32.415224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:32.416642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:32.417331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:32.418033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:32.489435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=4 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:32.577196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:32.586183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:32.587837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:32.589266 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c605ff7b-7699-4f90-9490-60719984fd9d tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.214059 Oct 05 20:27:32.590322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 432/860] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:32 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:27:32.661460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:32.672920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-933d68d0-0ec1-4609-907a-f5120a82781f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.274106 Oct 05 20:27:32.693348 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-152c5a61-ac85-4be8-b070-dd9da9672590 req-01185e21-7fde-44a8-b782-a059f9f00a0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:32.699455 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 429/861] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:32 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:32.711793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-152c5a61-ac85-4be8-b070-dd9da9672590 req-01185e21-7fde-44a8-b782-a059f9f00a0a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:32.712455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-152c5a61-ac85-4be8-b070-dd9da9672590 req-01185e21-7fde-44a8-b782-a059f9f00a0a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:32.712891 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-152c5a61-ac85-4be8-b070-dd9da9672590 req-01185e21-7fde-44a8-b782-a059f9f00a0a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:32.727238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-152c5a61-ac85-4be8-b070-dd9da9672590 req-01185e21-7fde-44a8-b782-a059f9f00a0a service nova] Creating event network-changed:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:27:32.738158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-152c5a61-ac85-4be8-b070-dd9da9672590 req-01185e21-7fde-44a8-b782-a059f9f00a0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045788 Oct 05 20:27:32.738790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 433/862] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:33.619660 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:33.621110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:33.633424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:33.634537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:33.635277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:33.637039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:33.638085 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:33.638741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:33.706094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:33.707510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:33.717005 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:33.719078 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:33.719971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:33.721132 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:33.721946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:33.722591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:33.909441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:33.928248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:33.931303 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:33.939338 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5a809380-9a0b-417f-94d7-09dce69f6fcd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.323783 Oct 05 20:27:33.947922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 430/863] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:33 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:33.968261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-482182804"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:33.972378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:33.987137 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:33.987665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:33.988097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:33.988796 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:33.989425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:33.990299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:34.059254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:34.073390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e0fbc60f-8b68-4ddd-b877-2fa92ae2eedd tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.372497 Oct 05 20:27:34.074465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 434/864] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:33 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:34.195003 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.network.security_group_api [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Adding security group 41184cc0-3c3a-49ca-940b-e811ad010d26 to port a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e Oct 05 20:27:34.968494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:34.969171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:34.976160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:34.976757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:34.977267 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:34.978092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:34.978615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:34.979039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:34.998147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-71ebeee1-9a97-4ad1-9a0b-d50efa9a7f80 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/action" status: 202 len: 0 microversion: 2.1 time: 1.035159 Oct 05 20:27:35.002974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 431/865] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:27:33 2022] POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/action => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:27:35.009933 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:35.010393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:35.019886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:35.020508 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:35.020952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:35.021911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:35.022375 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:35.023152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:35.160758 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:35.170705 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:35.172735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:35.177764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-959ac621-1c63-4f63-8db2-54152a852cb7 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.211516 Oct 05 20:27:35.191355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 435/866] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:34 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:27:35.203572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-b915c34c-0d76-474e-af7c-652e383dd755 req-08bcc8b7-a261-4d5f-9905-a4a2ba802b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:35.214393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-b915c34c-0d76-474e-af7c-652e383dd755 req-08bcc8b7-a261-4d5f-9905-a4a2ba802b9f service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:35.214884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-b915c34c-0d76-474e-af7c-652e383dd755 req-08bcc8b7-a261-4d5f-9905-a4a2ba802b9f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:35.215318 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-b915c34c-0d76-474e-af7c-652e383dd755 req-08bcc8b7-a261-4d5f-9905-a4a2ba802b9f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:35.230083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-b915c34c-0d76-474e-af7c-652e383dd755 req-08bcc8b7-a261-4d5f-9905-a4a2ba802b9f service nova] Creating event network-changed:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:27:35.236288 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-b915c34c-0d76-474e-af7c-652e383dd755 req-08bcc8b7-a261-4d5f-9905-a4a2ba802b9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043521 Oct 05 20:27:35.237227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 436/867] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:35.245231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:35.246209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:35.253909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:35.254681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:35.255364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:35.256247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:35.256863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:35.257449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:35.293580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:35.305025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6c06ebee-0642-4c8a-a533-d93a4a21806b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1760 microversion: 2.1 time: 0.300884 Oct 05 20:27:35.307640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 432/868] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:35 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1760 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:35.632034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:35.655168 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-83fcf121-ab56-45cd-8e65-7f36b725a02c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.404319 Oct 05 20:27:35.656759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 437/869] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:35 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:35.763636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-090fc3c5-a21f-4890-b723-947e86ff1c37 req-a66821b5-95f0-4115-9ffd-6ce9e8ad7202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e31a6c-f85c-451e-83f9-0e8ed25b885a", "name": "network-vif-plugged", "status": "completed", "tag": "3078e672-706f-44df-af9c-a4de3b8cc302"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:35.782140 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-090fc3c5-a21f-4890-b723-947e86ff1c37 req-a66821b5-95f0-4115-9ffd-6ce9e8ad7202 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:35.782804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-090fc3c5-a21f-4890-b723-947e86ff1c37 req-a66821b5-95f0-4115-9ffd-6ce9e8ad7202 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:35.783467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-090fc3c5-a21f-4890-b723-947e86ff1c37 req-a66821b5-95f0-4115-9ffd-6ce9e8ad7202 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:35.822067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-090fc3c5-a21f-4890-b723-947e86ff1c37 req-a66821b5-95f0-4115-9ffd-6ce9e8ad7202 service nova] Creating event network-vif-plugged:3078e672-706f-44df-af9c-a4de3b8cc302 for instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a on hv-cinder-80152 Oct 05 20:27:35.827840 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-090fc3c5-a21f-4890-b723-947e86ff1c37 req-a66821b5-95f0-4115-9ffd-6ce9e8ad7202 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133861 Oct 05 20:27:35.828939 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 433/870] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:36.209091 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:36.210462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:36.218382 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:36.219077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:36.219659 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:36.220361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:36.220997 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:36.221697 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:36.371444 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:36.381225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:36.383216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:36.384474 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-92628c27-19d6-4247-b811-d4b46a759186 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.182608 Oct 05 20:27:36.402524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 438/871] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:36 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:36.683329 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:36.684044 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:36.692914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:36.692914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:36.692914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:36.693647 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:36.694218 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:36.694912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:36.865215 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:36.883768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-743f8c2e-47d5-456f-8c63-92e53797a003 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1363 microversion: 2.1 time: 0.204451 Oct 05 20:27:36.883768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 434/872] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:36 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:37.412056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:37.412503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:37.418538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:37.419027 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:37.419468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:37.420767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:37.421231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:37.421689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:37.571075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:37.579358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:37.580837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:37.582067 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-77f7dd36-ed37-48b4-a324-4cc96e2d8d00 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.174308 Oct 05 20:27:37.582602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 439/873] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:37 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:37.816764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5e401598-a116-44e2-89d6-7e09b99f1805 tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Action: 'create', calling method: .version_select at 0x7f3e02440b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-578240983", "metadata": {"Type": "work"}}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:37.906188 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:37.906800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:37.912778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:37.913262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:37.913732 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:37.914427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:37.914886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:37.915319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:37.919421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:38.049386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:38.058643 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ea693d4e-a302-42fa-880a-9a28cdddfcbb tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1549 microversion: 2.1 time: 0.156138 Oct 05 20:27:38.059534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 440/874] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:37 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:27:38.084739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:38.085240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:38.091257 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:38.091756 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:38.092797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:38.093752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:38.094161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:38.094594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:38.118659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5e401598-a116-44e2-89d6-7e09b99f1805 tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.418483 Oct 05 20:27:38.119782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 435/875] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Oct 5 20:27:37 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 20:27:38.132785 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4b3e2f6b-98cd-4b7e-b3ba-8ec785f41fe3 tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Calling method '.version_select at 0x7f3e02457040>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:38.177567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-00e2ca8a-28a8-49da-b605-76ce5539483c tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098266 Oct 05 20:27:38.178124 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 441/876] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:27:38 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:38.186764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4b3e2f6b-98cd-4b7e-b3ba-8ec785f41fe3 tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d" status: 200 len: 352 microversion: 2.1 time: 0.057979 Oct 05 20:27:38.187333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 436/877] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:27:38 2022] GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:38.608686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:38.609296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:38.615173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:38.615661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:38.616094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:38.616780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:38.617229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:38.617674 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:38.838823 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:38.846868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:38.848299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:38.849459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b838b73e-ec85-4f4e-82da-78687262c514 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.245758 Oct 05 20:27:38.850047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 442/878] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:38 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:27:39.186857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-a4baba7e-bd3f-4e3e-afea-f4a53aec36f4 req-ab95928c-1815-49e4-8d03-3c82bd6dcf9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57e31a6c-f85c-451e-83f9-0e8ed25b885a", "tag": "3078e672-706f-44df-af9c-a4de3b8cc302"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:39.202533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0ed83b48-49cf-4743-b281-741a109ddba3 tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Calling method '.version_select at 0x7f3e026881f0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:39.257208 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0ed83b48-49cf-4743-b281-741a109ddba3 tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d" status: 200 len: 353 microversion: 2.1 time: 0.059499 Oct 05 20:27:39.258038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 443/879] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:27:39 2022] GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:39.272570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5787c502-a5ba-439a-8ad0-0c7e303c69dd tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Calling method '.version_select at 0x7f3e026883a0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:39.325716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5787c502-a5ba-439a-8ad0-0c7e303c69dd tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d" status: 200 len: 353 microversion: 2.1 time: 0.057136 Oct 05 20:27:39.327192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 444/880] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:27:39 2022] GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d => generated 353 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:39.345612 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-190cb748-faa3-4578-aa4d-827ec894b4de tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Calling method '.version_select at 0x7f3e028190d0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:39.364752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a4baba7e-bd3f-4e3e-afea-f4a53aec36f4 req-ab95928c-1815-49e4-8d03-3c82bd6dcf9b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:39.365463 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a4baba7e-bd3f-4e3e-afea-f4a53aec36f4 req-ab95928c-1815-49e4-8d03-3c82bd6dcf9b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:39.366092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a4baba7e-bd3f-4e3e-afea-f4a53aec36f4 req-ab95928c-1815-49e4-8d03-3c82bd6dcf9b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:39.376740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-a4baba7e-bd3f-4e3e-afea-f4a53aec36f4 req-ab95928c-1815-49e4-8d03-3c82bd6dcf9b service nova] Creating event network-changed:3078e672-706f-44df-af9c-a4de3b8cc302 for instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a on hv-cinder-80152 Oct 05 20:27:39.381962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-a4baba7e-bd3f-4e3e-afea-f4a53aec36f4 req-ab95928c-1815-49e4-8d03-3c82bd6dcf9b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.199914 Oct 05 20:27:39.383030 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 437/881] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:39.416780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-190cb748-faa3-4578-aa4d-827ec894b4de tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d" status: 202 len: 0 microversion: 2.1 time: 0.075723 Oct 05 20:27:39.417347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 445/882] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:27:39 2022] DELETE /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:27:39.426888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-13f5d3bf-e478-46b6-aaf2-d3e8b5a65d3a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Calling method '.version_select at 0x7f3e02440790>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:39.483992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-13f5d3bf-e478-46b6-aaf2-d3e8b5a65d3a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d" status: 200 len: 352 microversion: 2.1 time: 0.061548 Oct 05 20:27:39.484906 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 438/883] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:27:39 2022] GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:27:39.879344 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:39.880075 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:39.886455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:39.887256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:39.887772 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:39.888537 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:39.889170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:39.889846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:40.307578 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:40.315649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:40.317360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:40.318550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f40b494b-0afe-4589-af84-e96234c72f8f tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.447206 Oct 05 20:27:40.319113 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 446/884] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:39 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:40.499709 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-48a0087f-19b7-4d69-a1a0-fe4ab2c56e9a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Calling method '.version_select at 0x7f3e02457040>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:40.526951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-48a0087f-19b7-4d69-a1a0-fe4ab2c56e9a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] HTTP exception thrown: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-48a0087f-19b7-4d69-a1a0-fe4ab2c56e9a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Request method failure captured: Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d HTTP/1.1 Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPei5nqqFNtyfYjikpb2R6HbaPWPKe-vytoZfGKYCVou5jcMeyh3WpOYp-21U-8kSitO4GHQT7n6z-CckuFq6O9m-V2f5iMsBMA_Xf3EPFIDO7xK8yPKT2SG6cbWuKN2o7awFhAirNpeHnZGDhv-bVhSQa3dkrGr5ycFjzpFxB6Bs70M Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: a2077a9d747246eb9d17700fd494987e Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-VolumesGetTestJSON-500472460 Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:27:40.530742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2077a9d747246eb9d17700fd494987e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_a2077a9d747246eb9d17700fd494987e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/a2077a9d747246eb9d17700fd494987e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/a2077a9d747246eb9d17700fd494987e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-VolumesGetTestJSON-500472460 Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: a2077a9d747246eb9d17700fd494987e Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-VolumesGetTestJSON-500472460 Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-VolumesGetTestJSON-500472460-project Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: d1e1393529ec4268add61bce90febb47 Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-VolumesGetTestJSON-500472460-project Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '33297645-2144-4351-ab98-de833f4db60d'} Oct 05 20:27:40.532242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. (HTTP 404) (Request-ID: req-2bc070c3-7b6f-4b9d-9e05-2f7c74876b34) Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:40.533170 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:27:40.534626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 20:27:40.535992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-48a0087f-19b7-4d69-a1a0-fe4ab2c56e9a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] Returning 404 to user: Volume 33297645-2144-4351-ab98-de833f4db60d could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-48a0087f-19b7-4d69-a1a0-fe4ab2c56e9a tempest-VolumesGetTestJSON-500472460 tempest-VolumesGetTestJSON-500472460-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d" status: 404 len: 109 microversion: 2.1 time: 0.037355 Oct 05 20:27:40.537351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 439/885] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:27:40 2022] GET /compute/v2.1/os-volumes/33297645-2144-4351-ab98-de833f4db60d => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:27:41.344149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:41.344762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:41.351231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:41.351724 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:41.352248 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:41.352856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:41.353320 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:41.353777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:41.487552 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:41.495557 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:41.497023 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:41.498260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-92a5e7ee-9980-4af8-bf7d-e488fa86ab74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.158067 Oct 05 20:27:41.498799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 447/886] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:41 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:42.523664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:42.524393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:42.531719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:42.532199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:42.532627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:42.533319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:42.533929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:42.534353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:42.669800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:42.679076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:42.680661 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:42.681838 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c0a82d5c-f5a5-472f-b641-934fcd8e8392 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.161846 Oct 05 20:27:42.688412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 440/887] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:42 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:43.709612 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:43.710126 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:43.715412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:43.717847 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:43.718525 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:43.718965 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:43.719661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:43.720113 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:43.720538 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:43.855870 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:43.864077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:43.867574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:43.867574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-40271b4c-8f21-47e7-8035-ffe1dcde95bd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.161997 Oct 05 20:27:43.867574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 448/888] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:43 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:44.897627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:44.898237 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:44.904732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:44.905222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:44.905691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:44.907246 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:44.907715 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:44.908145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:45.048739 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:45.056724 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:45.058209 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:45.059361 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-fef5815d-d3cc-40ee-8833-82054ab0f692 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.165593 Oct 05 20:27:45.059917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 441/889] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:44 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:46.084181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:46.085483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:46.091924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:46.092401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:46.092829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:46.093560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:46.094010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:46.094451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:46.237367 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:46.245974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:46.247355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:46.248558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6c1430c1-e141-46e5-86ae-4573c25b47db tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.168235 Oct 05 20:27:46.249112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 449/890] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:46 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:47.274372 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:47.274977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:47.282161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:47.282573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:47.283013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:47.284077 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:47.284202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:47.284572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:47.469575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:47.479892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:47.481588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:47.483048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d84c8296-2a9c-4256-9819-0be920c79f42 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.212520 Oct 05 20:27:47.498942 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 442/891] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:47 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:48.508413 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:48.509062 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:48.515879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:48.516370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:48.516808 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:48.517507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:48.518014 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:48.518438 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:48.724358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:48.732941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:48.735145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:48.736575 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7c3a9901-1888-462e-a36d-8ab63e903fab tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.232105 Oct 05 20:27:48.737217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 450/892] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:48 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:49.767460 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:49.768083 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:49.775211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:49.775742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:49.776250 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:49.777117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:49.777571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:49.778007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:49.987351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:49.995509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:49.996970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:49.998152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2ce42159-f1bf-4f78-a5fb-e5efccc5b755 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1742 microversion: 2.20 time: 0.237959 Oct 05 20:27:49.998721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 443/893] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:49 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1742 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:51.024223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:51.024834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:51.031413 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:51.031926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:51.032359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:51.033048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:51.033497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:51.033946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:51.164048 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:51.173216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:51.174685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:51.175838 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-97d7b792-9fc0-4a0a-965b-d0d858a147b5 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1742 microversion: 2.20 time: 0.155595 Oct 05 20:27:51.176394 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 451/894] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:51 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:52.201093 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:52.202915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:52.209832 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:52.210497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:52.210925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:52.212010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:52.212999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:52.213978 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:52.403180 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:52.412425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:52.414330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:52.416047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f181ca24-f042-4848-811f-3af1a9995e77 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.218729 Oct 05 20:27:52.416879 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 444/895] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:52 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:53.445131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:53.445945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:53.456390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:53.459818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:53.460380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:53.461216 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:53.467097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:53.467659 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:53.550936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-5112bded-951d-4060-b70a-75ff95a0b12d req-d07db08e-38f2-4b25-b17c-6de863b7647c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "name": "network-vif-plugged", "status": "completed", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:53.572281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=64 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:53.593635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-5112bded-951d-4060-b70a-75ff95a0b12d req-d07db08e-38f2-4b25-b17c-6de863b7647c service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:53.600803 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-5112bded-951d-4060-b70a-75ff95a0b12d req-d07db08e-38f2-4b25-b17c-6de863b7647c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:53.611921 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-5112bded-951d-4060-b70a-75ff95a0b12d req-d07db08e-38f2-4b25-b17c-6de863b7647c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:53.634312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-5112bded-951d-4060-b70a-75ff95a0b12d req-d07db08e-38f2-4b25-b17c-6de863b7647c service nova] Creating event network-vif-plugged:938a7d9f-3a0f-4c79-80ef-ca3e36f0894f for instance 4afc70e1-0337-42dd-9976-27f07f9baff3 on hv-cinder-80152 Oct 05 20:27:53.647241 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-5112bded-951d-4060-b70a-75ff95a0b12d req-d07db08e-38f2-4b25-b17c-6de863b7647c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100075 Oct 05 20:27:53.649864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 445/896] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:27:53.730060 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:53.741409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:53.742882 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:53.744291 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a0a5f794-385d-4a57-aa37-a00409177181 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.303875 Oct 05 20:27:53.745320 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 452/897] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:53 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:54.774168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:54.775536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:54.782849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:54.783679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:54.784340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:54.785042 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:54.785613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:54.785966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:54.974423 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:54.983719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:54.985684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:54.987269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b51820c4-f20f-457c-b720-a95941fd94b6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.218468 Oct 05 20:27:54.987834 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 446/898] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:54 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:56.021648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:56.029790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:56.042002 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:56.042695 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:56.043211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:56.044159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:56.044672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:56.045293 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:56.225046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:56.237903 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:56.240151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:56.255097 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-000eb9fe-e279-4123-9d70-683f6e0cdc2b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.227810 Oct 05 20:27:56.258804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 453/899] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:56 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:57.271454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:57.272061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:57.278997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:57.279758 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:57.280859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:57.281787 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:57.282395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:57.282993 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:57.465563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:57.474506 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:57.476068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:57.477444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-56af05df-286e-4425-9883-386fb427f729 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.209918 Oct 05 20:27:57.478045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 447/900] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:57 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:57.860236 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:27:57.862721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:57.869805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:57.870544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:57.876160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:57.876160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:57.876160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:57.876160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:57.965876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c82d54d1-a80a-42fe-b1f5-7f96b9abe962 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/action" status: 202 len: 0 microversion: 2.1 time: 0.110221 Oct 05 20:27:57.967235 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 454/901] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:27:57 2022] POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:27:57.977436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:57.979144 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:57.991478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:57.992118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:57.993400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:57.995250 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:57.997031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:57.997616 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:58.178016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:58.188923 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1ca4493c-bba3-4760-9299-e2e548cc2824 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1752 microversion: 2.1 time: 0.217011 Oct 05 20:27:58.202617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 448/902] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:57 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1752 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:58.506502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:58.507464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:58.515101 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:58.515829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:58.516478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:58.517342 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:58.518198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:58.520810 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:58.754554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:58.765827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:58.767389 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:58.768684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bd93af58-c340-462c-a7f4-999656e63fdf tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.267970 Oct 05 20:27:58.781608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 455/903] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:58 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:27:59.215094 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:59.215669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:59.222817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:59.223522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:59.224729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:59.225438 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:59.225934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:59.226357 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:59.243169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=100 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:27:59.395444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:59.404789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ff48ee08-f7ba-4f08-828e-f7ee44262edd tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.193702 Oct 05 20:27:59.407415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 449/904] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:27:59 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:27:59.793663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:27:59.795035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:27:59.802759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:59.803496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:59.804047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:59.804908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:27:59.805596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:27:59.806336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:27:59.961077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:59.970583 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:59.972056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:27:59.973240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8647f809-1c7d-49ee-a5a3-bd98a9488845 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.183867 Oct 05 20:27:59.977851 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 456/905] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:27:59 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:00.432604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:00.434037 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:00.443888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:00.444668 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:00.445278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:00.446075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:00.446598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:00.447853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:00.623594 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:00.632961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-41d730ab-f8f9-43b3-b65d-148a6095c7b6 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.204463 Oct 05 20:28:00.633611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 450/906] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:00 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:00.998454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:00.999090 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:01.006004 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:01.006811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:01.007243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:01.007967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:01.008419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:01.008841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:01.154239 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:01.163482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:01.165303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:01.166631 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d9aca1d3-cf2f-4687-a751-6fa026a8821a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1737 microversion: 2.20 time: 0.172097 Oct 05 20:28:01.167219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 457/907] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:00 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:01.658957 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:01.659596 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:01.667454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:01.667940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:01.668368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:01.669418 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:01.670084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:01.670846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:01.823991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:01.832688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-31b1e428-d298-4f9b-af04-4bf4d6097576 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.177609 Oct 05 20:28:01.833257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 451/908] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:01 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:02.192926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:02.193719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:02.200095 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:02.200638 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:02.201077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:02.201950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:02.202452 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:02.202948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:02.399571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:02.408181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:02.409641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:02.410806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-cdb6e7e6-0628-48f6-ab92-3b7a6e0eeca8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1719 microversion: 2.20 time: 0.222051 Oct 05 20:28:02.411364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 458/909] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:02 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:02.856147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:02.856617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:02.863138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:02.863614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:02.864045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:02.864928 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:02.865373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:02.865988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:03.008656 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:03.017812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-712372fd-a512-400a-a396-cf1e7e7b7507 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.165670 Oct 05 20:28:03.018374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 452/910] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:02 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:03.437160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:03.437807 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:03.444378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:03.444863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:03.445296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:03.446021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:03.446473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:03.446896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:03.450905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:03.581291 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:03.589483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:03.591183 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:03.592510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dc9d4bc3-274c-4870-a98b-e00be114f17b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1719 microversion: 2.20 time: 0.159743 Oct 05 20:28:03.593236 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 459/911] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:03 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:04.040390 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:04.040995 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:04.047404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:04.047883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:04.048315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:04.049122 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:04.049732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:04.050159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:04.191426 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:04.199823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-21ec7c71-b4b6-475c-9825-b4fba3a7c05b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.163301 Oct 05 20:28:04.200377 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 453/912] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:04 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:04.619151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:04.619872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:04.628330 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:04.628824 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:04.629321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:04.630016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:04.630411 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:04.630828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:04.863498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:04.872219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:04.873686 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:04.874857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bdc14270-908e-45a0-90bf-3801ddf492aa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1722 microversion: 2.20 time: 0.259603 Oct 05 20:28:04.890303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 460/913] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:04 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:04.901811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8dbadaa-e90c-430e-88e1-e3074644f4b4"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:04.904245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:04.910783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:04.911263 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:04.911693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:04.912381 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:04.912828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:04.913250 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.215825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8f17c2f1-dd4e-4f8f-8c5a-63d5f0022a88 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.318063 Oct 05 20:28:05.216595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 454/914] 10.222.0.23 () {62 vars in 1364 bytes} [Wed Oct 5 20:28:04 2022] POST /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-volume_attachments => generated 188 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 20:28:05.228409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:05.229018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:05.235865 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.236355 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.236790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.237494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.237950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.238368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.361541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:05.362050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:05.368209 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.368716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.369141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.369868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.370540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.371123 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.513491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:05.527954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-37837250-52a6-4ef4-b45f-1456bba40509 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.304950 Oct 05 20:28:05.544778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 461/915] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:05 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:05.544778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-739209b8-a217-422d-996d-a3800b6acdda req-2fbf1a7b-1868-416b-ae47-db0274c2f736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "name": "network-vif-unplugged", "status": "completed", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:05.545960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-739209b8-a217-422d-996d-a3800b6acdda req-2fbf1a7b-1868-416b-ae47-db0274c2f736 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.546559 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-739209b8-a217-422d-996d-a3800b6acdda req-2fbf1a7b-1868-416b-ae47-db0274c2f736 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.547037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-739209b8-a217-422d-996d-a3800b6acdda req-2fbf1a7b-1868-416b-ae47-db0274c2f736 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.558547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.compute.server_external_events [req-739209b8-a217-422d-996d-a3800b6acdda req-2fbf1a7b-1868-416b-ae47-db0274c2f736 service nova] Unable to find a host for instance 4afc70e1-0337-42dd-9976-27f07f9baff3. Dropping event network-vif-unplugged {{(pid=120351) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 20:28:05.559422 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-739209b8-a217-422d-996d-a3800b6acdda req-2fbf1a7b-1868-416b-ae47-db0274c2f736 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029317 Oct 05 20:28:05.560009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 462/916] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 20:28:05.656113 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f5c1e2e5-902e-49e0-8544-552d586ad120 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-volume_attachments/f8dbadaa-e90c-430e-88e1-e3074644f4b4" status: 202 len: 0 microversion: 2.20 time: 0.299030 Oct 05 20:28:05.660650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 455/917] 10.222.0.23 () {60 vars in 1457 bytes} [Wed Oct 5 20:28:05 2022] DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-volume_attachments/f8dbadaa-e90c-430e-88e1-e3074644f4b4 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 20:28:05.721166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:05.721778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:05.728128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.728589 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.729015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.729723 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.730173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.730593 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.760617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120351) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 20:28:05.825840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5aa8f032-44be-4745-88c8-e0d73a2bb115 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "POST /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/action" status: 202 len: 0 microversion: 2.20 time: 0.108500 Oct 05 20:28:05.829506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 463/918] 10.222.0.23 () {62 vars in 1319 bytes} [Wed Oct 5 20:28:05 2022] POST /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:28:05.834689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:05.835529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:05.841812 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.842375 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.842880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.843663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:05.844211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:05.844813 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:05.984482 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:05.993602 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:05.995283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:05.996461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9c9bfead-0b08-42d8-8cf1-b0755d3d6627 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1670 microversion: 2.20 time: 0.165713 Oct 05 20:28:06.005422 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 456/919] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:05 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:06.553807 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:06.554415 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:06.565818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:06.566181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:06.566594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:06.567663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:06.568011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:06.568437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:06.763889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:06.773009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2098c293-09e1-4a7a-b862-3630b52e9114 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.223162 Oct 05 20:28:06.789971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 464/920] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:06 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:07.026858 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:07.028159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:07.036836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:07.037809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:07.038648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:07.039977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:07.040671 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:07.041447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:07.417884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:07.427425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:07.429092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:07.430220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2da1af59-9d60-485d-8526-eed4108de647 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1670 microversion: 2.20 time: 0.411556 Oct 05 20:28:07.431043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 457/921] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:07 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:07.797547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:07.798479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:07.804920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:07.805398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:07.805855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:07.806539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:07.806992 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:07.807412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:08.034496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:08.044156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2d734794-ae18-47c8-881a-fe84d72df48d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.250757 Oct 05 20:28:08.044786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 465/922] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:07 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:08.456331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:08.457572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:08.464074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:08.464565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:08.465004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:08.465742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:08.466206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:08.466630 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:08.604684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:08.613225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:08.614757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:08.615898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-252fc4b3-bfb0-4fbf-92f4-60d4e95bcacc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.163697 Oct 05 20:28:08.616445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 458/923] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:08 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:09.070909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:09.072199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:09.080083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:09.080906 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:09.081968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:09.082904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:09.083752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:09.084469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:09.237542 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:09.245932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e338d06f-4981-4c0b-834a-6e389c853939 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.179293 Oct 05 20:28:09.246436 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 466/924] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:09 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:09.592286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:09.593483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:09.600372 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:09.600860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:09.601297 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:09.602039 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:09.602500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:09.602934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:09.628246 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-81399f85-d187-4bec-9d10-f632c44f3cd8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/ips" status: 200 len: 150 microversion: 2.1 time: 0.039875 Oct 05 20:28:09.628823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 459/925] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:28:09 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:09.643622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:09.645408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:09.655570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:09.657060 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:09.657684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:09.658658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:09.659119 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:09.659615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:09.842244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:09.852237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:09.853721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:09.855620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c71db988-ad68-4449-abf3-d1bf235d5e74 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.216640 Oct 05 20:28:09.856340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 467/926] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:09 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:10.271859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:10.272765 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:10.284681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:10.285541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:10.286167 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:10.287096 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:10.287887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:10.288588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:10.469744 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:10.479213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-69452b85-4d7e-4031-b12d-c00cbaec880e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.213080 Oct 05 20:28:10.479972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 460/927] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:10 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:10.883574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:10.884192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:10.890588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:10.891309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:10.891921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:10.892628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:10.893255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:10.893728 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:11.099509 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:11.112725 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:11.121991 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:11.126993 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:11.128249 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:11.131585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f97ac52a-82a4-49c1-a970-7dcba4f3660e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.250149 Oct 05 20:28:11.134176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 468/928] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:10 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:11.143091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:11.143934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:11.144654 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:11.145857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:11.146599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:11.147225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:11.151962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:11.504800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:11.505434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:11.511527 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:11.512018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:11.512553 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:11.513192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:11.513676 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:11.514099 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:11.682551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:11.692904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a0cb4385-84a2-4a71-9db0-015dcd617c89 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.192018 Oct 05 20:28:11.693486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 469/929] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:11 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:12.163413 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:12.164215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:12.170634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:12.171154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:12.171595 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:12.172964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:12.173420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:12.173876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:12.355463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:12.364549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:12.366014 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:12.367190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-64679384-e256-4a68-a49b-e663c4da650b tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.207819 Oct 05 20:28:12.368999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 470/930] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:12 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:12.717762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:12.718369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:12.726401 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:12.726892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:12.727331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:12.728033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:12.728487 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:12.728900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:12.888407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:12.898451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-81834145-20ba-4aeb-ba65-81bc1d409201 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.184652 Oct 05 20:28:12.899392 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 471/931] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:12 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:13.394672 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:13.395379 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:13.401727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:13.402331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:13.402840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:13.403616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:13.404149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:13.404648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:13.545471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:13.557163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:13.558715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:13.559845 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8b4a7f35-b5c0-462e-a3b4-dcfff1f0206e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.169180 Oct 05 20:28:13.560760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 472/932] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:13 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:13.922721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:13.923369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:13.925285 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:13.930094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:13.930594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:13.931049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:13.942736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:13.943254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:13.943681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:14.120861 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:14.130319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0eb92a11-ab1b-47aa-8725-c5c0c82323c7 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.211475 Oct 05 20:28:14.130892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 473/933] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:13 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:14.588539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:14.590269 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:14.597435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:14.598025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:14.598560 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:14.599490 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:14.600225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:14.600678 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:14.738681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:14.747818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:14.749275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:14.751034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bb40bb9e-7599-4637-b6ca-266878f90cb6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.166589 Oct 05 20:28:14.752104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 474/934] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:14 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:15.154176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:15.154821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:15.160967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:15.161821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:15.162554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:15.163507 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:15.164180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:15.164851 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:15.186730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:15.618747 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:15.627857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-57b96fa0-9cef-4a1c-89ae-92ff9b3bb49d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.478327 Oct 05 20:28:15.628458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 475/935] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:15 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:15.778802 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:15.779752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:15.787234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:15.788160 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:15.789100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:15.790066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:15.790729 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:15.791656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:15.980301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:15.990753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:15.992580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:15.994869 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bd21f60c-b80b-46ff-b04c-6f558e8af72e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.222111 Oct 05 20:28:15.996262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 476/936] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:15 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:16.652127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:16.652736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:16.659638 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:16.660189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:16.660780 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:16.661468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:16.662482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:16.663033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:16.893404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:16.902748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-96056dc8-9eb5-4e70-9e5d-b6217664d347 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.255043 Oct 05 20:28:16.903351 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 477/937] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:16 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:17.024451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:17.025105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:17.036975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:17.037856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:17.039281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:17.040494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:17.041141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:17.042125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:17.251597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:17.260306 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:17.261778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:17.263302 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-93c19e16-09dd-48b5-96b0-9db2460a6edc tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.244033 Oct 05 20:28:17.264519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 478/938] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:17 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:17.927407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:17.928093 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:17.939665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:17.940159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:17.940597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:17.941309 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:17.941804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:17.942496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:18.096118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:18.107865 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-efffba3f-7fd1-4e17-8266-2a7c65436a39 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.183955 Oct 05 20:28:18.108627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 479/939] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:17 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:18.289821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:18.290530 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:18.296682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:18.297268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:18.297811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:18.298597 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:18.299124 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:18.299631 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:18.454675 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:18.464605 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:18.466856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:18.468165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-73910695-1e03-4374-90e2-4c8ec94b94ca tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.182478 Oct 05 20:28:18.469715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 480/940] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:18 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:19.131659 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:19.132282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:19.138644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:19.139128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:19.139562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:19.140249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:19.140703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:19.141125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:19.283155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:19.291691 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-32fa18cc-3a4e-4c39-b71f-9c6054fea49f tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1757 microversion: 2.1 time: 0.163972 Oct 05 20:28:19.292335 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 481/941] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:19 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:19.494777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:19.495579 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:19.501540 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:19.502028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:19.502465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:19.503161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:19.503619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:19.504062 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:19.639357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:19.648328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:19.649999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:19.651245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-142c299c-c4d4-4005-8a7e-23454642c8eb tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.160383 Oct 05 20:28:19.651857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 482/942] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:19 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:19.963279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8c08623d-dbfa-4c17-a71d-eb1fb9f4eb41 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.847463 Oct 05 20:28:19.963990 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 461/943] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:28:11 2022] POST /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 194 bytes in 8849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:20.315145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:20.315756 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:20.322404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:20.322886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:20.323323 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:20.324011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:20.324460 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:20.324884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:20.472493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:20.480755 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-acf3ea1c-519f-42e0-8fc7-a036d605f06c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1760 microversion: 2.1 time: 0.169497 Oct 05 20:28:20.481324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 483/944] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:20 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:20.677282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:20.677984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:20.684677 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:20.685164 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:20.685635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:20.686338 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:20.686797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:20.687268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:20.816916 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:20.825143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:20.826627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:20.828283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3d3e6844-d8fd-4e50-9bf4-0d99f65c8111 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.155329 Oct 05 20:28:20.828851 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 462/945] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:20 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:21.854881 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:21.855522 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:21.862726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:21.863210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:21.863644 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:21.864332 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:21.864811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:21.865232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:21.995333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:22.003407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:22.004836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:22.006019 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3bdad0bb-66d7-41fa-82e7-9a675daaf7d0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.155115 Oct 05 20:28:22.006568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 484/946] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:21 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:23.032640 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:23.033174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:23.039675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:23.040165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:23.040600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:23.041816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:23.042284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:23.042711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:23.170464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:23.178477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:23.179919 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:23.181079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-258c91c2-0936-46ca-927f-d40f97365dd6 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.153027 Oct 05 20:28:23.181664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 463/947] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:23 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:23.585646 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-35ee0f73-4ecd-46c5-8353-bdf4cff9cf17 req-c3397392-dfd1-43c0-81a6-7b3809c4b483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "name": "network-vif-plugged", "status": "completed", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:23.597435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-35ee0f73-4ecd-46c5-8353-bdf4cff9cf17 req-c3397392-dfd1-43c0-81a6-7b3809c4b483 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:23.597981 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-35ee0f73-4ecd-46c5-8353-bdf4cff9cf17 req-c3397392-dfd1-43c0-81a6-7b3809c4b483 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:23.598404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-35ee0f73-4ecd-46c5-8353-bdf4cff9cf17 req-c3397392-dfd1-43c0-81a6-7b3809c4b483 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:23.611128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-35ee0f73-4ecd-46c5-8353-bdf4cff9cf17 req-c3397392-dfd1-43c0-81a6-7b3809c4b483 service nova] Creating event network-vif-plugged:938a7d9f-3a0f-4c79-80ef-ca3e36f0894f for instance 4afc70e1-0337-42dd-9976-27f07f9baff3 on hv-cinder-80152 Oct 05 20:28:23.616647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-35ee0f73-4ecd-46c5-8353-bdf4cff9cf17 req-c3397392-dfd1-43c0-81a6-7b3809c4b483 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035514 Oct 05 20:28:23.617789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 485/948] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:24.208052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:24.208677 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:24.211216 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=38 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:24.216471 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:24.216955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:24.217398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:24.218127 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:24.218576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:24.219069 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:24.344969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:24.353078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:24.354535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:24.355671 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-84dc6d02-6622-486e-9257-d1a13f7fb12e tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.152143 Oct 05 20:28:24.356223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 464/949] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:24 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:25.383714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:25.384502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:25.391308 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:25.391867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:25.392374 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:25.393229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:25.393987 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:25.394569 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:25.534593 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:25.542826 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:25.544260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:25.545421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ad3b14ea-f062-4c7d-be43-5c7fd663ce72 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.167669 Oct 05 20:28:25.546039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 486/950] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:25 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:26.330126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:26.330656 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:26.336887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:26.337368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:26.337842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:26.338539 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:26.338992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:26.339412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:26.364359 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6205e044-8dab-49c0-b87e-27235ff1c52d tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/ips" status: 200 len: 146 microversion: 2.1 time: 0.038195 Oct 05 20:28:26.365097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 465/951] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:28:26 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:26.575451 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:26.576443 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:26.583645 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:26.584215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:26.584722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:26.585493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:26.586039 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:26.586600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:26.722821 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:26.731109 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:26.732536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:26.733712 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7a3ec888-466e-49b7-afa4-20e684c31ad9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.163098 Oct 05 20:28:26.734288 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 487/952] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:26 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:27.757908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:27.758520 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:27.764892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:27.765373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:27.766401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:27.767090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:27.767546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:27.767966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:27.898383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:27.906309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:27.907748 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:27.908886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b4d0dc3c-d724-42ea-a9e1-1052f6bb7169 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1728 microversion: 2.20 time: 0.154810 Oct 05 20:28:27.909444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 466/953] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:27 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:28:28.755893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "452d7096-53d9-41fa-8839-4800b443842c"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:28.758477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:28.765127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:28.766166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:28.766640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:28.767344 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:28.767833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:28.768666 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:28.934024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:28.934636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:28.940980 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:28.941467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:28.941937 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:28.942899 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:28.943359 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:28.943790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:29.072925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:29.083260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:29.084701 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:29.085894 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-73714514-d829-4bd6-b12d-d7fd673ca48a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1715 microversion: 2.20 time: 0.155734 Oct 05 20:28:29.086453 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 467/954] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:28:28 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1715 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 20:28:29.275722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3fa87d69-8d89-4fbf-8ed2-1d4cce27a8e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.523613 Oct 05 20:28:29.276472 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 488/955] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:28:28 2022] POST /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments => generated 194 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:29.809145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:29.811576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:29.818056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:29.818547 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:29.818981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:29.819685 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:29.820138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:29.820560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:29.908398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Invalid volume: volume ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 is already attached to instances: c26f72d3-ab1b-472f-9551-b044693c2168 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: POST /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments HTTP/1.1 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 74 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:28:29.910117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {"volumeAttachment": {"volumeId": "ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4"}} Oct 05 20:28:29.911749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Invalid volume: volume ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 is already attached to instances: c26f72d3-ab1b-472f-9551-b044693c2168 Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'server_id': 'c26f72d3-ab1b-472f-9551-b044693c2168', 'body': {'volumeAttachment': {'volumeId': 'ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4'}}} Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 is already attached to instances: c26f72d3-ab1b-472f-9551-b044693c2168 Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:29.912892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 is already attached to instances: c26f72d3-ab1b-472f-9551-b044693c2168 Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:29.914604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:28:29.916319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:28:29.916319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:28:29.916319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:28:29.916319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 is already attached to instances: c26f72d3-ab1b-472f-9551-b044693c2168 Oct 05 20:28:29.916319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:29.917329 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 400 to user: Invalid volume: volume ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 is already attached to instances: c26f72d3-ab1b-472f-9551-b044693c2168 {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:28:29.918204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-962aab39-d2b9-4d85-b763-44d3f169cbdf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113063 Oct 05 20:28:29.918762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 468/956] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:28:29 2022] POST /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:28:29.983547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:29.984744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:29.991418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:29.991907 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:29.992423 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:29.993023 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:29.993525 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:29.993952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:30.075307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lazy-loading 'services' on Instance uuid c26f72d3-ab1b-472f-9551-b044693c2168 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:28:30.144830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a9c5c5f3-fa6e-4dc9-b6ce-0e630b5bf8cf tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments/ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4" status: 202 len: 0 microversion: 2.1 time: 0.165294 Oct 05 20:28:30.145411 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 489/957] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:28:29 2022] DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments/ef3a5f24-0a0e-4bc3-bb52-57dee128f2b4 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:28:30.154235 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:30.156926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:30.164525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:30.165016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:30.165430 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:30.166226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:30.166702 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:30.167124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:30.197827 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-63da9b88-c98f-4b1d-8324-c4e4e17fb0ba tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Oct 05 20:28:30.198575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 469/958] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:30 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:31.211933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:31.214424 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:31.221372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:31.221947 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:31.222396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:31.223163 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:31.223616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:31.224037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:31.250696 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:31.256458 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-09bb9e05-d7f4-4e02-aae6-ccddfdb283b0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049500 Oct 05 20:28:31.257019 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 490/959] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:31 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:32.268864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:32.271058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:32.277363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:32.277882 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:32.278319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:32.279015 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:32.279469 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:32.279891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:32.308473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4581fc59-9959-46df-8bf9-8eb37693bae9 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044203 Oct 05 20:28:32.309033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 470/960] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:32 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:33.321374 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:33.323681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:33.331506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:33.332156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:33.332655 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:33.333416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:33.333975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:33.334399 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:33.365908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7f3026e4-6bf1-4005-a4e8-9a156f03928d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049371 Oct 05 20:28:33.366495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 491/961] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:33 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:28:34.379063 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:34.381751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:34.388152 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:34.388632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:34.389072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:34.389807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:34.390264 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:34.390690 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:34.419410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-39851761-1230-44ba-9006-6ca7d51f0032 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Oct 05 20:28:34.419961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 471/962] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:34 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:35.432388 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:35.434607 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:35.441609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:35.442087 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:35.442773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:35.443483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:35.443918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:35.444343 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:35.473773 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1f481ebf-08d7-453d-a260-7a9090baddd0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Oct 05 20:28:35.474328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 492/963] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:35 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:36.486477 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:36.488628 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:36.495483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:36.495963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:36.496402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:36.497095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:36.497578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:36.498007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:36.529831 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a4144c5a-c10d-4462-b58a-3ce4c237d8b1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047222 Oct 05 20:28:36.530398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 472/964] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:36 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:36.839345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:36.841497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:36.847830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:36.848315 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:36.848758 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:36.849448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:36.849931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:36.850359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:36.880985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4336b042-7cc5-490c-9217-b79de1fd03be tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045592 Oct 05 20:28:36.881588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 493/965] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:36 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:36.892884 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:36.893382 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:36.899234 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:36.899721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:36.900159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:36.900855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:36.901310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:36.901764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:36.932254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1b2c8318-e5f4-4cd3-8994-c20a2e0d931b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/452d7096-53d9-41fa-8839-4800b443842c" status: 200 len: 194 microversion: 2.1 time: 0.043877 Oct 05 20:28:36.932835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 473/966] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Oct 5 20:28:36 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/452d7096-53d9-41fa-8839-4800b443842c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:28:37.704182 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:37.706447 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:37.712293 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:37.712768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:37.713193 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:37.713905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:37.714353 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:37.714778 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:37.744405 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-17ce2397-172a-41be-bd76-4ae14d61e919 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.205249 Oct 05 20:28:37.744956 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 494/967] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:37 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168/os-volume_attachments => generated 25 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:28:37.810509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:37.811009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:37.817747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:37.818231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:37.818664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:37.819362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:37.819817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:37.820251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:37.848061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:28:37.920493 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-125fc498-0c5d-4ca2-8bad-fd41c3b59b91 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 204 len: 0 microversion: 2.1 time: 0.113682 Oct 05 20:28:37.921078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 474/968] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:28:37 2022] DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:28:37.929500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:37.930139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:37.936410 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:37.936909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:37.937351 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:37.938074 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:37.938526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:37.938950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:38.074886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:38.083238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c023c9f7-1b4d-493a-a6c9-db97405bad48 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1681 microversion: 2.1 time: 0.157711 Oct 05 20:28:38.083805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 495/969] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:37 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:38.278873 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "628d0001-470a-413d-adc7-dd0baee26bf8"}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:38.281288 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:38.287310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:38.287800 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:38.288242 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:38.288952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:38.289481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:38.289983 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:38.295740 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:39.106578 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:39.107227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:39.114366 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:39.114854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:39.115295 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:39.115995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:39.116455 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:39.116884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:39.248096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:39.255819 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b6d30efb-bf83-48ea-882d-02054ae172ec tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1681 microversion: 2.1 time: 0.153155 Oct 05 20:28:39.256382 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 496/970] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:39 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:39.592778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b11b2e5c-99d8-4dad-b145-858e5b7942e0 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "POST /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.318086 Oct 05 20:28:39.593456 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 475/971] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:28:38 2022] POST /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments => generated 194 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:40.278578 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:40.279092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:40.286303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:40.286787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:40.287218 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:40.287945 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:40.288445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:40.288761 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:40.478915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:40.486988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8bcf82a0-6196-4226-a92d-ae479728f6b2 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1681 microversion: 2.1 time: 0.212434 Oct 05 20:28:40.487937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 497/972] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:40 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:40.830034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-466c9101-b89d-4be8-8418-7167b161d775 req-836f7ac5-c2fd-4564-88cc-918e2cd1dd4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c26f72d3-ab1b-472f-9551-b044693c2168", "name": "network-vif-deleted", "tag": "21c37543-10a5-4609-9753-10ac54200c0e"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:40.840690 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-466c9101-b89d-4be8-8418-7167b161d775 req-836f7ac5-c2fd-4564-88cc-918e2cd1dd4c service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:40.841314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-466c9101-b89d-4be8-8418-7167b161d775 req-836f7ac5-c2fd-4564-88cc-918e2cd1dd4c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:40.841910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-466c9101-b89d-4be8-8418-7167b161d775 req-836f7ac5-c2fd-4564-88cc-918e2cd1dd4c service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:40.853179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-466c9101-b89d-4be8-8418-7167b161d775 req-836f7ac5-c2fd-4564-88cc-918e2cd1dd4c service nova] Creating event network-vif-deleted:21c37543-10a5-4609-9753-10ac54200c0e for instance c26f72d3-ab1b-472f-9551-b044693c2168 on hv-cinder-80152 Oct 05 20:28:40.859620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-466c9101-b89d-4be8-8418-7167b161d775 req-836f7ac5-c2fd-4564-88cc-918e2cd1dd4c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034040 Oct 05 20:28:40.860997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 476/973] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:41.513389 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:41.514608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:41.521930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:41.522431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:41.530162 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:41.531019 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:41.531501 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:41.533473 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:41.580690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:41.581172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:41.581852 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:41.582269 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lazy-loading 'fault' on Instance uuid c26f72d3-ab1b-472f-9551-b044693c2168 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:28:41.630387 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:41.638789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-34e88795-6c14-40da-9907-702675899e71 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 200 len: 1331 microversion: 2.1 time: 0.129142 Oct 05 20:28:41.639379 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 498/974] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:41 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 1331 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:42.663666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:42.665068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:42.672102 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:42.672611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:42.673045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:42.673769 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:42.674223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:42.674669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:42.688245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 HTTP/1.1 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:28:42.690599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:28:42.692025 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'c26f72d3-ab1b-472f-9551-b044693c2168'} Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:28:42.693032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:28:42.694898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:42.696248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:28:42.696248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5e79ad3a-70b0-4bbb-b373-d767e4955092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 404 len: 111 microversion: 2.1 time: 0.032577 Oct 05 20:28:42.696248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 477/975] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:42 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:28:42.702580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7d1d6be3-0b4c-4cbb-9151-2696b60782b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '.version_select at 0x7f3e025ef700>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:42.724711 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7d1d6be3-0b4c-4cbb-9151-2696b60782b5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810865079" status: 202 len: 0 microversion: 2.1 time: 0.026474 Oct 05 20:28:42.725300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 499/976] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Oct 5 20:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1810865079 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:28:43.356309 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-71178d59-5c90-4e60-bc25-fc0769412853 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: .version_select at 0x7f3e02730f70>, body: {"keypair": {"name": "tempest-keypair-1644500392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHEEeSOJ+ZRVgWIPeDiJYxYhSIqStEmhKGAcLJGkmjYNiv9gELcjoWzP4Kkj1uhZo3ivhiw8rDJjmeOnOhraEiDvXiQ5gQLZ1wl8IWuhLhPQCxHhM7tdlRBbHynX02Zjsg=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:43.372286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-71178d59-5c90-4e60-bc25-fc0769412853 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:28:43.376095 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-71178d59-5c90-4e60-bc25-fc0769412853 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:28:43.397302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-71178d59-5c90-4e60-bc25-fc0769412853 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044950 Oct 05 20:28:43.397935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 478/977] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:28:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:44.624540 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-416007662", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b866581-0156-4c8b-8621-7be5c67dfe5d"}], "security_groups": [{"name": "tempest-securitygroup--124346176"}], "key_name": "tempest-keypair-1644500392", "user_data": "}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:44.634106 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:44.731491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] validate_networks() for [('9b866581-0156-4c8b-8621-7be5c67dfe5d', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:28:45.105977 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:28:45.106398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:28:45.106915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:28:45.107360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:28:45.107767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:28:45.117180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:45.117687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:45.118147 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:45.118867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:45.119313 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:45.119731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:45.136245 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:28:45.140463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Getting quotas for user 10d2803e109849fda2828f66f51b8a0c and project 05398ef99be34b57b61052a0f07f57f8. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:28:45.151638 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:28:45.153950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:28:45.200532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f0bdd343-2857-4e73-af10-f31aa9f22a7f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.580845 Oct 05 20:28:45.201181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 500/978] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:28:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:28:45.213435 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cbf42c5d-865f-4c82-b8c8-66931708dd03 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:45.214184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cbf42c5d-865f-4c82-b8c8-66931708dd03 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:45.279393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cbf42c5d-865f-4c82-b8c8-66931708dd03 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:45.286790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cbf42c5d-865f-4c82-b8c8-66931708dd03 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1241 microversion: 2.1 time: 0.077733 Oct 05 20:28:45.287352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 479/979] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:45 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:46.310210 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:46.310817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:46.317937 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:46.318415 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:46.318842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:46.319533 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:46.319983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:46.320402 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:46.380972 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:46.388537 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3279a83c-b428-4aa1-9b0a-a80eeef4af92 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1293 microversion: 2.1 time: 0.082863 Oct 05 20:28:46.389103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 501/980] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:46 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:47.157229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:47.159533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:47.166057 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.166540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.166975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.167671 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.168130 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.168556 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.198565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b7bde90f-e6c7-41c1-9fff-7f4d775bf127 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045228 Oct 05 20:28:47.199141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 480/981] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:47 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:47.342018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:47.343056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:47.349786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.350537 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.351254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.352212 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.352918 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.353600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.404149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dba1b49b-f4cb-4656-ac78-3f63d7e311e1 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/452d7096-53d9-41fa-8839-4800b443842c" status: 200 len: 194 microversion: 2.1 time: 0.066633 Oct 05 20:28:47.417102 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:47.417759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:47.420563 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 502/982] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Oct 5 20:28:47 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/452d7096-53d9-41fa-8839-4800b443842c => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:47.426286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.426844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.427245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.428234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:47.428797 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:47.430915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.431393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.432116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.434939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.435695 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.436207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.437137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:47.437698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:47.438199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:47.508116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:47.515935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-fb192281-62d4-4419-8476-0a3f1fcf6395 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1299 microversion: 2.1 time: 0.102855 Oct 05 20:28:47.516687 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 481/983] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:47 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:47.528828 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lazy-loading 'services' on Instance uuid 57e31a6c-f85c-451e-83f9-0e8ed25b885a {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:28:47.599244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fc55eaa4-5bfc-4420-8769-798ae11c144f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/452d7096-53d9-41fa-8839-4800b443842c" status: 202 len: 0 microversion: 2.1 time: 0.176854 Oct 05 20:28:47.599833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 503/984] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:28:47 2022] DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/452d7096-53d9-41fa-8839-4800b443842c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:28:48.540257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:48.540920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:48.547948 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:48.548546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:48.549234 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:48.549967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:48.550423 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:48.550844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:48.695580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:48.704598 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e3aa8032-1bc5-4ff6-b9f6-dbcbeb844f0e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.168503 Oct 05 20:28:48.706144 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 482/985] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:48 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:48.865446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-7e17f3bc-c410-4e8c-a747-e288479ca5f4 req-2fb7e32e-f694-4395-8851-a7833ea205dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4be578-f1f8-4c59-8cd6-80a0cd591484", "tag": "eb9eff72-e2d3-4280-8fef-24864fd828f9"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:48.876155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-7e17f3bc-c410-4e8c-a747-e288479ca5f4 req-2fb7e32e-f694-4395-8851-a7833ea205dd service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:48.876769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-7e17f3bc-c410-4e8c-a747-e288479ca5f4 req-2fb7e32e-f694-4395-8851-a7833ea205dd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:48.877980 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-7e17f3bc-c410-4e8c-a747-e288479ca5f4 req-2fb7e32e-f694-4395-8851-a7833ea205dd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:48.890614 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-7e17f3bc-c410-4e8c-a747-e288479ca5f4 req-2fb7e32e-f694-4395-8851-a7833ea205dd service nova] Creating event network-changed:eb9eff72-e2d3-4280-8fef-24864fd828f9 for instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 on hv-cinder-80152 Oct 05 20:28:48.896255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-7e17f3bc-c410-4e8c-a747-e288479ca5f4 req-2fb7e32e-f694-4395-8851-a7833ea205dd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038782 Oct 05 20:28:48.897198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 504/986] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:28:49.728292 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:49.728902 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:49.735708 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:49.736221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:49.736660 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:49.737385 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:49.738000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:49.738543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:49.790843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:49.791419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:49.797603 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:49.798022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:49.798452 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:49.799133 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:49.799582 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:49.800024 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:49.828444 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6bc1c4e2-67a6-4139-86d3-05f0dcc62d96 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/628d0001-470a-413d-adc7-dd0baee26bf8" status: 200 len: 194 microversion: 2.1 time: 0.041879 Oct 05 20:28:49.829205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 505/987] 10.222.0.23 () {58 vars in 1413 bytes} [Wed Oct 5 20:28:49 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/628d0001-470a-413d-adc7-dd0baee26bf8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:28:49.839692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:49.840179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:49.846806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:49.847305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:49.847775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:49.848479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:49.848962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:49.849395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:49.876006 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:49.884097 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9452e2a3-c2d2-43c3-a6ce-3a2b13f6aee0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.159688 Oct 05 20:28:49.884960 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 483/988] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:49 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:49.933904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lazy-loading 'services' on Instance uuid 57e31a6c-f85c-451e-83f9-0e8ed25b885a {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:28:50.003573 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d00d66d5-5cd7-4eef-8d66-cd58867dd435 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/628d0001-470a-413d-adc7-dd0baee26bf8" status: 202 len: 0 microversion: 2.1 time: 0.167406 Oct 05 20:28:50.004147 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 506/989] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:28:49 2022] DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments/628d0001-470a-413d-adc7-dd0baee26bf8 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 20:28:50.907835 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:50.908567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:50.915425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:50.915928 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:50.916465 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:50.917190 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:50.917860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:50.918296 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:51.058511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:51.067117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-349455c0-506b-4f9c-94e9-47a40802ef38 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.163310 Oct 05 20:28:51.068410 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 484/990] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:50 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:52.091690 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:52.092406 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:52.106398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.106901 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.108892 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.109999 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.110677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.111112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.257048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:52.259404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:52.263926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:52.265952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.266444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.266886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.268136 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.268599 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.269029 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.272202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7fedbe1d-3229-4823-955a-ecf4d34b7bac tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.184690 Oct 05 20:28:52.272757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 507/991] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:52 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:52.298270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2ca2a846-f1af-4724-8e4f-ac0418564dd3 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045164 Oct 05 20:28:52.298836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 485/992] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:52 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 20:28:52.413136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:52.415463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:52.421814 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.422323 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.422781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.423463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.423962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.424413 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.428219 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:52.454029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4703dcc9-5f5a-41cb-bb79-ebcb823d9ca5 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045042 Oct 05 20:28:52.454564 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 508/993] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:28:52 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:28:52.518693 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:52.519819 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:52.525804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.526278 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.526711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.527394 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.527844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.528261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.553260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:28:52.629584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e3bd06b0-2ab4-4c01-abeb-04b2d5beea6f tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 204 len: 0 microversion: 2.1 time: 0.114401 Oct 05 20:28:52.630357 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 486/994] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:28:52 2022] DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:28:52.638726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:52.639375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:52.645868 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.646359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.646800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.647495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:52.647950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:52.648377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:52.780846 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:52.788576 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-95ab1d35-192f-4c75-aa4c-39e0b2273524 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1674 microversion: 2.1 time: 0.153853 Oct 05 20:28:52.789141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 509/995] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:52 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:53.296223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:53.297051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:53.304197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:53.304679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:53.305112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:53.305934 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:53.306387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:53.306889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:53.434759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:53.442678 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e6c638be-2e57-4f84-bf1a-b037960e5fe5 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.150897 Oct 05 20:28:53.443238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 487/996] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:53 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:53.740437 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-3a10db42-2ee8-4c61-94e9-4afba4ed57aa req-9ceccd8c-6839-41b6-bf36-f6ece2a13f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4be578-f1f8-4c59-8cd6-80a0cd591484", "name": "network-vif-plugged", "status": "completed", "tag": "eb9eff72-e2d3-4280-8fef-24864fd828f9"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:53.750189 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3a10db42-2ee8-4c61-94e9-4afba4ed57aa req-9ceccd8c-6839-41b6-bf36-f6ece2a13f74 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:53.750670 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3a10db42-2ee8-4c61-94e9-4afba4ed57aa req-9ceccd8c-6839-41b6-bf36-f6ece2a13f74 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:53.751111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3a10db42-2ee8-4c61-94e9-4afba4ed57aa req-9ceccd8c-6839-41b6-bf36-f6ece2a13f74 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:53.762387 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-3a10db42-2ee8-4c61-94e9-4afba4ed57aa req-9ceccd8c-6839-41b6-bf36-f6ece2a13f74 service nova] Creating event network-vif-plugged:eb9eff72-e2d3-4280-8fef-24864fd828f9 for instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 on hv-cinder-80152 Oct 05 20:28:53.767150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-3a10db42-2ee8-4c61-94e9-4afba4ed57aa req-9ceccd8c-6839-41b6-bf36-f6ece2a13f74 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030521 Oct 05 20:28:53.767737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 510/997] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:53.812786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:53.813404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:53.820103 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:53.820589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:53.821029 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:53.821749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:53.822206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:53.822631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:53.953266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:53.960903 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e5c8aa56-7108-4260-a383-282bef7eaf20 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1674 microversion: 2.1 time: 0.152197 Oct 05 20:28:53.961472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 488/998] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:53 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:54.466959 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:54.467692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:54.474834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:54.475324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:54.475759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:54.476454 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:54.476910 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:54.477331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:54.610944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:54.618630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4c7cdb0e-cc28-4d2c-b4ff-a76acb1d85f7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.156187 Oct 05 20:28:54.619184 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 511/999] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:54 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:54.984866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:54.985481 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:54.988646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:54.993951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:54.994447 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:54.994893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:54.995601 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:54.996067 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:54.996504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:55.126434 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:55.135046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c1d5c749-484b-4b7b-ac73-603945dade49 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1674 microversion: 2.1 time: 0.154002 Oct 05 20:28:55.135552 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 489/1000] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:54 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:55.621877 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-33a03c88-481d-42f3-8d6a-d37826e2e21b req-899a66a6-d35b-4cda-a387-2c38bc4f467f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57e31a6c-f85c-451e-83f9-0e8ed25b885a", "name": "network-vif-deleted", "tag": "3078e672-706f-44df-af9c-a4de3b8cc302"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:55.628531 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:55.629619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:55.633448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-33a03c88-481d-42f3-8d6a-d37826e2e21b req-899a66a6-d35b-4cda-a387-2c38bc4f467f service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:55.634172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-33a03c88-481d-42f3-8d6a-d37826e2e21b req-899a66a6-d35b-4cda-a387-2c38bc4f467f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:55.634820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-33a03c88-481d-42f3-8d6a-d37826e2e21b req-899a66a6-d35b-4cda-a387-2c38bc4f467f service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:55.642798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:55.643421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:55.651124 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=6 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:55.657664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:55.658499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:55.659814 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:55.660912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:55.661860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:55.662499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:55.670558 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-33a03c88-481d-42f3-8d6a-d37826e2e21b req-899a66a6-d35b-4cda-a387-2c38bc4f467f service nova] Creating event network-vif-deleted:3078e672-706f-44df-af9c-a4de3b8cc302 for instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a on hv-cinder-80152 Oct 05 20:28:55.680312 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-33a03c88-481d-42f3-8d6a-d37826e2e21b req-899a66a6-d35b-4cda-a387-2c38bc4f467f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061942 Oct 05 20:28:55.681289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 512/1001] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:55.850333 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:55.864254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dd027bf1-2b4b-410d-9303-3a949a2c85fb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1366 microversion: 2.1 time: 0.225253 Oct 05 20:28:55.865425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 490/1002] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:55 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:28:56.159333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:56.160057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:56.166211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:56.166693 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:56.167124 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:56.167970 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:56.168428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:56.168849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:56.199574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:56.200056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:56.200487 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:56.200924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lazy-loading 'fault' on Instance uuid 57e31a6c-f85c-451e-83f9-0e8ed25b885a {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:28:56.241689 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c28866ff5b2a4dd4ba05270b369f064e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45fc2abd2bae4264b1081c1673e3095e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:56.249799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1d7db919-7fad-4632-854f-f076b628fdbf tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 200 len: 1328 microversion: 2.1 time: 0.094855 Oct 05 20:28:56.250876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 513/1003] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:56 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 1328 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:56.889864 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:56.890646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:56.897544 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:56.898044 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:56.898511 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:56.899216 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:56.899673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:56.900098 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:57.050790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:28:57.060383 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6cd2783c-b4fc-4e2d-b56d-08c3cc64d17e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1557 microversion: 2.1 time: 0.176799 Oct 05 20:28:57.074497 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 491/1004] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:56 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:28:57.086921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:57.087968 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:57.094954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:57.095658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:57.096276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:57.097292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:57.097961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:57.098544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:57.234895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f6f0d165-35e2-44e5-a240-0d45276ea439 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152802 Oct 05 20:28:57.235789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 514/1005] 10.222.0.23 () {58 vars in 1275 bytes} [Wed Oct 5 20:28:57 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-interface => generated 285 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:28:57.274718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:57.275323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:28:57.281681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:57.282180 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:57.282827 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:57.283542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:57.284061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:57.284666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:57.288823 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:28:57.300908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] HTTP exception thrown: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Request method failure captured: Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a HTTP/1.1 Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedqc1aiTUHgQhoq2Sfwv85nae1gd3kVyBf1O4mNx0ReHfQghHh90lXo6KjQn04u7yu1UgtxJp5UjNajKtVA_GbdsJtGlmKHXvYfBs3CztRyWghO3E3O3a777evDid6YhCWEY_Hp2jU53VP-y7NdxdKIJ9XfulaWncFdtUYfeamsaPw Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:28:57.303597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: c28866ff5b2a4dd4ba05270b369f064e Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:28:57.304986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '57e31a6c-f85c-451e-83f9-0e8ed25b885a'} Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:28:57.305806 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:28:57.307155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:28:57.308273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Returning 404 to user: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:28:57.308273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-57da880e-9db3-45f5-baf8-342743c226ba tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 404 len: 111 microversion: 2.1 time: 0.035666 Oct 05 20:28:57.308273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 492/1006] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:28:57 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:28:57.315242 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-130b90a0-4473-4245-a52a-ad691a8bba45 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '.version_select at 0x7f3e02838940>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:28:57.335553 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-130b90a0-4473-4245-a52a-ad691a8bba45 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090456404" status: 202 len: 0 microversion: 2.1 time: 0.024044 Oct 05 20:28:57.339682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 515/1007] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Oct 5 20:28:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090456404 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:28:58.939666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-c4cf3f80-d76f-4c66-a66d-92e0429ca7f8 req-b668e637-2563-435a-a160-78a1783845fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb4be578-f1f8-4c59-8cd6-80a0cd591484", "tag": "eb9eff72-e2d3-4280-8fef-24864fd828f9"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:28:58.952717 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c4cf3f80-d76f-4c66-a66d-92e0429ca7f8 req-b668e637-2563-435a-a160-78a1783845fb service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:28:58.953737 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c4cf3f80-d76f-4c66-a66d-92e0429ca7f8 req-b668e637-2563-435a-a160-78a1783845fb service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:28:58.954610 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c4cf3f80-d76f-4c66-a66d-92e0429ca7f8 req-b668e637-2563-435a-a160-78a1783845fb service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:28:58.968833 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-c4cf3f80-d76f-4c66-a66d-92e0429ca7f8 req-b668e637-2563-435a-a160-78a1783845fb service nova] Creating event network-changed:eb9eff72-e2d3-4280-8fef-24864fd828f9 for instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 on hv-cinder-80152 Oct 05 20:28:58.987367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-c4cf3f80-d76f-4c66-a66d-92e0429ca7f8 req-b668e637-2563-435a-a160-78a1783845fb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051232 Oct 05 20:28:58.988588 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 493/1008] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:00.220975 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-482182804"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:00.221920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:00.229386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:00.229921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:00.230368 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:00.231079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:00.231541 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:00.231986 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:00.371586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.network.security_group_api [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Removing security group 41184cc0-3c3a-49ca-940b-e811ad010d26 from port a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e Oct 05 20:29:00.671926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8129b09c-b8b0-4fb7-8176-5c6fac241196 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/action" status: 202 len: 0 microversion: 2.1 time: 0.455380 Oct 05 20:29:00.672568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 516/1009] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:29:00 2022] POST /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:29:01.002744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-75469aec-fd82-4843-94b1-26eefa5e0edc req-a1b62197-c464-44e4-8580-1b0038a0ef93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:01.004842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:01.005433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:01.012493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-75469aec-fd82-4843-94b1-26eefa5e0edc req-a1b62197-c464-44e4-8580-1b0038a0ef93 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:01.013354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-75469aec-fd82-4843-94b1-26eefa5e0edc req-a1b62197-c464-44e4-8580-1b0038a0ef93 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:01.013818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-75469aec-fd82-4843-94b1-26eefa5e0edc req-a1b62197-c464-44e4-8580-1b0038a0ef93 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:01.015118 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:01.015604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:01.016043 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:01.016742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:01.017260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:01.019046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:01.028293 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-75469aec-fd82-4843-94b1-26eefa5e0edc req-a1b62197-c464-44e4-8580-1b0038a0ef93 service nova] Creating event network-changed:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:29:01.033901 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-75469aec-fd82-4843-94b1-26eefa5e0edc req-a1b62197-c464-44e4-8580-1b0038a0ef93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034725 Oct 05 20:29:01.034696 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 517/1010] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:29:01.038204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] HTTP exception thrown: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Request method failure captured: Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a HTTP/1.1 Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedqc1aiTUHgQhoq2Sfwv85nae1gd3kVyBf1O4mNx0ReHfQghHh90lXo6KjQn04u7yu1UgtxJp5UjNajKtVA_GbdsJtGlmKHXvYfBs3CztRyWghO3E3O3a777evDid6YhCWEY_Hp2jU53VP-y7NdxdKIJ9XfulaWncFdtUYfeamsaPw Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:01.041184 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: c28866ff5b2a4dd4ba05270b369f064e Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.042747 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '57e31a6c-f85c-451e-83f9-0e8ed25b885a'} Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:01.043533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.044682 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.045963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Returning 404 to user: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:01.045963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d9ac2b87-104f-4864-a70a-3a9a2aa7520b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 404 len: 111 microversion: 2.1 time: 0.045611 Oct 05 20:29:01.045963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 494/1011] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:00 2022] DELETE /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:01.056825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:01.057738 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: 57e31a6c-f85c-451e-83f9-0e8ed25b885a] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:01.064030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:01.064516 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:01.064955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:01.065768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:01.066229 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:01.067478 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:01.080731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] HTTP exception thrown: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Request method failure captured: Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a HTTP/1.1 Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedqc1aiTUHgQhoq2Sfwv85nae1gd3kVyBf1O4mNx0ReHfQghHh90lXo6KjQn04u7yu1UgtxJp5UjNajKtVA_GbdsJtGlmKHXvYfBs3CztRyWghO3E3O3a777evDid6YhCWEY_Hp2jU53VP-y7NdxdKIJ9XfulaWncFdtUYfeamsaPw Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:01.082698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: c28866ff5b2a4dd4ba05270b369f064e Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.084251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '57e31a6c-f85c-451e-83f9-0e8ed25b885a'} Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:01.085107 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. Oct 05 20:29:01.086503 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:01.087751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Returning 404 to user: Instance 57e31a6c-f85c-451e-83f9-0e8ed25b885a could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:01.087751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9ef8ec6f-5f98-4372-bab3-723175bef6af tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a" status: 404 len: 111 microversion: 2.1 time: 0.033636 Oct 05 20:29:01.087751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 518/1012] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:01 2022] GET /compute/v2.1/servers/57e31a6c-f85c-451e-83f9-0e8ed25b885a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:02.116406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:02.116906 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:02.123357 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.123844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.124285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.124986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.125449 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.125910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.206393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lazy-loading 'services' on Instance uuid b83ee763-3577-4268-8b24-a16c4b106432 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:29:02.238446 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:02.239536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:02.245648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.246142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.246580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.247274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.247731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.248156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.262251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] HTTP exception thrown: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Request method failure captured: Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 HTTP/1.1 Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedqc1aiTUHgQhoq2Sfwv85nae1gd3kVyBf1O4mNx0ReHfQghHh90lXo6KjQn04u7yu1UgtxJp5UjNajKtVA_GbdsJtGlmKHXvYfBs3CztRyWghO3E3O3a777evDid6YhCWEY_Hp2jU53VP-y7NdxdKIJ9XfulaWncFdtUYfeamsaPw Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:02.263967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: c28866ff5b2a4dd4ba05270b369f064e Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.265627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'cc97e634-82d8-4433-bee0-6d00f84075e7'} Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:02.270521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.271905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.273098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Returning 404 to user: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:02.273098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5ae247ef-a1e8-44dd-ab18-f8d5047f9853 tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 404 len: 111 microversion: 2.1 time: 0.031386 Oct 05 20:29:02.273098 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 519/1013] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:02 2022] DELETE /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:02.276030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:02.276834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] [instance: cc97e634-82d8-4433-bee0-6d00f84075e7] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:02.283196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.283859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.284498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.285240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.285893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.286336 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.292213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0df94b3f-f9f8-4fe7-adff-31f53a8dcd64 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments/27b0d118-27fe-4a0c-96b6-41bc971851fe" status: 202 len: 0 microversion: 2.1 time: 0.179163 Oct 05 20:29:02.293368 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 495/1014] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:29:02 2022] DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments/27b0d118-27fe-4a0c-96b6-41bc971851fe => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:29:02.301668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] HTTP exception thrown: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.302451 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Request method failure captured: Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 HTTP/1.1 Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedqc1aiTUHgQhoq2Sfwv85nae1gd3kVyBf1O4mNx0ReHfQghHh90lXo6KjQn04u7yu1UgtxJp5UjNajKtVA_GbdsJtGlmKHXvYfBs3CztRyWghO3E3O3a777evDid6YhCWEY_Hp2jU53VP-y7NdxdKIJ9XfulaWncFdtUYfeamsaPw Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:02.303632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/45fc2abd2bae4264b1081c1673e3095e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 45fc2abd2bae4264b1081c1673e3095e Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeTestJSON-187708516 Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: c28866ff5b2a4dd4ba05270b369f064e Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeTestJSON-187708516-project Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.305196 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'cc97e634-82d8-4433-bee0-6d00f84075e7'} Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:02.306092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. Oct 05 20:29:02.307513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:02.310553 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:02.310743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] Returning 404 to user: Instance cc97e634-82d8-4433-bee0-6d00f84075e7 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:02.310743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c5f75992-397a-476e-b046-9c116273542b tempest-AttachVolumeTestJSON-187708516 tempest-AttachVolumeTestJSON-187708516-project] 10.222.0.23 "GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7" status: 404 len: 111 microversion: 2.1 time: 0.040282 Oct 05 20:29:02.311399 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 520/1015] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:02 2022] GET /compute/v2.1/servers/cc97e634-82d8-4433-bee0-6d00f84075e7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:29:02.323050 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.323917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.325187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.326404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:02.327059 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:02.327683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:02.360875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e157adbb-06d6-48f1-900d-656b9f825e4c tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063059 Oct 05 20:29:02.361881 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 496/1016] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:29:02 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:03.112730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-3e55f53b-1db2-409e-abe1-cf726e38d006 req-6bd0b454-5002-43ff-9041-b5931aa7fa8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:03.124545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3e55f53b-1db2-409e-abe1-cf726e38d006 req-6bd0b454-5002-43ff-9041-b5931aa7fa8b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:03.125590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3e55f53b-1db2-409e-abe1-cf726e38d006 req-6bd0b454-5002-43ff-9041-b5931aa7fa8b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:03.126095 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-3e55f53b-1db2-409e-abe1-cf726e38d006 req-6bd0b454-5002-43ff-9041-b5931aa7fa8b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:03.140872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-3e55f53b-1db2-409e-abe1-cf726e38d006 req-6bd0b454-5002-43ff-9041-b5931aa7fa8b service nova] Creating event network-changed:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:29:03.146208 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-3e55f53b-1db2-409e-abe1-cf726e38d006 req-6bd0b454-5002-43ff-9041-b5931aa7fa8b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038597 Oct 05 20:29:03.147003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 521/1017] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:29:03.375279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:03.377466 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:03.384287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:03.384770 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:03.385202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:03.385920 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:03.386374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:03.386796 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:03.415284 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4d1f65e5-9ecc-47c5-ae07-1945b3ac229e tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044019 Oct 05 20:29:03.415853 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 497/1018] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:29:03 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:29:03.428033 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:03.428736 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:03.434873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:03.435358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:03.435792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:03.436482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:03.436935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:03.437359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:03.512268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] HTTP exception thrown: Instance b83ee763-3577-4268-8b24-a16c4b106432 is not attached to volume 27b0d118-27fe-4a0c-96b6-41bc971851fe Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Request method failure captured: Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments/27b0d118-27fe-4a0c-96b6-41bc971851fe HTTP/1.1 Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPeh1kfWOaj9UMrE2ycvlmDMl7aBmcG51HkS5shBuBpFbRgyVhzj_pE184OsgWD2hQG_AzwOT2GRTitLImvgRANB2T-4dw_3YLo27vBtgqeTpODVA2RD4B3PQij6wd0vj3FFfazUYDg73eQNitYS_nENG_SXBZXndjor1EpIKzz2UZ4I Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 5d5f5bc40cdc4be792aff778d3020c6d Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-TestMinimumBasicScenario-1703303721 Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:03.514735 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-TestMinimumBasicScenario-1703303721 Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 5d5f5bc40cdc4be792aff778d3020c6d Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1703303721 Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-TestMinimumBasicScenario-1703303721-project Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 5500db61c95f4245945784ae6b13f197 Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-TestMinimumBasicScenario-1703303721-project Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:03.516319 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance b83ee763-3577-4268-8b24-a16c4b106432 is not attached to volume 27b0d118-27fe-4a0c-96b6-41bc971851fe Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'server_id': 'b83ee763-3577-4268-8b24-a16c4b106432', 'id': '27b0d118-27fe-4a0c-96b6-41bc971851fe'} Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 27b0d118-27fe-4a0c-96b6-41bc971851fe. Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:03.517326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83ee763-3577-4268-8b24-a16c4b106432 is not attached to volume 27b0d118-27fe-4a0c-96b6-41bc971851fe Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83ee763-3577-4268-8b24-a16c4b106432 is not attached to volume 27b0d118-27fe-4a0c-96b6-41bc971851fe Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:03.518827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Returning 404 to user: Instance b83ee763-3577-4268-8b24-a16c4b106432 is not attached to volume 27b0d118-27fe-4a0c-96b6-41bc971851fe {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:03.520156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b3306762-4c48-4c90-8e69-7c6e30a881bb tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments/27b0d118-27fe-4a0c-96b6-41bc971851fe" status: 404 len: 154 microversion: 2.1 time: 0.093460 Oct 05 20:29:03.520156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 522/1019] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:29:03 2022] DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432/os-volume_attachments/27b0d118-27fe-4a0c-96b6-41bc971851fe => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:04.663889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:04.664568 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:04.671009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:04.671494 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:04.671926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:04.672819 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:04.673279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:04.673743 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:04.699310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:29:04.783367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-48fa529a-4ade-457f-8f05-29026b461fac tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 204 len: 0 microversion: 2.1 time: 0.123654 Oct 05 20:29:04.784753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 498/1020] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:04 2022] DELETE /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:29:04.793491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:04.794135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:04.800776 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:04.801687 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:04.802286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:04.803172 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:04.803789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:04.805643 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:04.962251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:04.970649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d9e493a6-b89e-4845-8062-d5cfe319896b tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1555 microversion: 2.1 time: 0.180694 Oct 05 20:29:04.971891 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 523/1021] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:04 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1555 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:05.996584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:05.997494 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:06.005669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:06.006287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:06.006859 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:06.007664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:06.008349 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:06.009018 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:06.169318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:06.176199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-450c00b2-e446-4a7f-b9ee-dc6529824e8a tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1555 microversion: 2.1 time: 0.184116 Oct 05 20:29:06.176965 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 499/1022] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:05 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:07.179026 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a2380aa3-8c9e-42ba-80c3-64887745cdf7 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Action: 'create', calling method: .version_select at 0x7f3e026e6f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-703261456", "metadata": {"Type": "work"}}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:07.198876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:07.199642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a2380aa3-8c9e-42ba-80c3-64887745cdf7 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Request method failure captured: Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 121 Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPekSKpPuUF37cK_JipRMgCI_1dkrWwJTe4GV551Daug5Nxf4t9D1X-TeUQMGlIAQMR30Rv3axWj0EFtcqi9HXFF9YmjqRaPohuSVZtl_JM4BubcG3i4zDhv5lFICw2LA7JqmbCIXWALa_qPogtK4QlvcW-LawctuwYe-WiYgqL7rwrQ Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:07.203900 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 97c9af8fba58431ea75a34fd6ed4af31 Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-703261456", "metadata": {"Type": "work"}}} Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:29:07.205465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-703261456', 'metadata': {'Type': 'work'}}}} Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise error Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi '#$%' Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:07.206543 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 20:29:07.207909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 20:29:07.210372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 20:29:07.210372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.210576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:07.210576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:07.210576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:07.210576 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:07.210962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:07.210962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:07.212321 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a2380aa3-8c9e-42ba-80c3-64887745cdf7 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:07.213331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a2380aa3-8c9e-42ba-80c3-64887745cdf7 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.160890 Oct 05 20:29:07.214088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 524/1023] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Oct 5 20:29:07 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:07.224585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a33995b8-fb8a-45a4-a2f2-69f92a7f605a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Action: 'create', calling method: .version_select at 0x7f3e026e0310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1053089906", "metadata": {"Type": "work"}}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a33995b8-fb8a-45a4-a2f2-69f92a7f605a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Request method failure captured: Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 120 Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPekSKpPuUF37cK_JipRMgCI_1dkrWwJTe4GV551Daug5Nxf4t9D1X-TeUQMGlIAQMR30Rv3axWj0EFtcqi9HXFF9YmjqRaPohuSVZtl_JM4BubcG3i4zDhv5lFICw2LA7JqmbCIXWALa_qPogtK4QlvcW-LawctuwYe-WiYgqL7rwrQ Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:07.230277 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 97c9af8fba58431ea75a34fd6ed4af31 Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1053089906", "metadata": {"Type": "work"}}} Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:29:07.231616 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1053089906', 'metadata': {'Type': 'work'}}}} Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise error Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi '0' Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:07.232496 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 20:29:07.234952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 20:29:07.236190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 20:29:07.236190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.236190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-a33995b8-fb8a-45a4-a2f2-69f92a7f605a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:07.236190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-a33995b8-fb8a-45a4-a2f2-69f92a7f605a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011257 Oct 05 20:29:07.236190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 525/1024] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Oct 5 20:29:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:07.239703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-d2e4f6b8-eaef-457a-91f8-3bcac839976d req-1ab2e536-309e-4d96-a3d4-bee5b58f8c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b83ee763-3577-4268-8b24-a16c4b106432", "name": "network-vif-deleted", "tag": "a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:07.250268 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d2e4f6b8-eaef-457a-91f8-3bcac839976d req-1ab2e536-309e-4d96-a3d4-bee5b58f8c35 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:07.250745 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d2e4f6b8-eaef-457a-91f8-3bcac839976d req-1ab2e536-309e-4d96-a3d4-bee5b58f8c35 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:07.251178 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-d2e4f6b8-eaef-457a-91f8-3bcac839976d req-1ab2e536-309e-4d96-a3d4-bee5b58f8c35 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:07.266335 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-d2e4f6b8-eaef-457a-91f8-3bcac839976d req-1ab2e536-309e-4d96-a3d4-bee5b58f8c35 service nova] Creating event network-vif-deleted:a9e3e3b2-5f4a-429d-ba7f-ec4fe5ec3e7e for instance b83ee763-3577-4268-8b24-a16c4b106432 on hv-cinder-80152 Oct 05 20:29:07.271494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-d2e4f6b8-eaef-457a-91f8-3bcac839976d req-1ab2e536-309e-4d96-a3d4-bee5b58f8c35 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037072 Oct 05 20:29:07.272331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 526/1025] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:07.277545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-32e290d4-0706-487e-b0e3-8e64f5250234 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Action: 'create', calling method: .version_select at 0x7f3e0299d310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-946957043", "metadata": {"Type": "work"}}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-32e290d4-0706-487e-b0e3-8e64f5250234 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Request method failure captured: Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 118 Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPekSKpPuUF37cK_JipRMgCI_1dkrWwJTe4GV551Daug5Nxf4t9D1X-TeUQMGlIAQMR30Rv3axWj0EFtcqi9HXFF9YmjqRaPohuSVZtl_JM4BubcG3i4zDhv5lFICw2LA7JqmbCIXWALa_qPogtK4QlvcW-LawctuwYe-WiYgqL7rwrQ Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:07.281383 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 97c9af8fba58431ea75a34fd6ed4af31 Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-946957043", "metadata": {"Type": "work"}}} Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:29:07.282966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-946957043', 'metadata': {'Type': 'work'}}}} Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise error Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi '' Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:07.283843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 20:29:07.285777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 20:29:07.287983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 20:29:07.287983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.287983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-32e290d4-0706-487e-b0e3-8e64f5250234 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:07.287983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-32e290d4-0706-487e-b0e3-8e64f5250234 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009431 Oct 05 20:29:07.287983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 527/1026] 10.222.0.23 () {60 vars in 1156 bytes} [Wed Oct 5 20:29:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:07.288319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5500db61c95f4245945784ae6b13f197', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5f5bc40cdc4be792aff778d3020c6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:07.293459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f6918e8e-bff6-4e78-8151-9aa65e912179 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Calling method '.version_select at 0x7f3e027df9d0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:07.293975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4127bb6b-710f-4c47-a4d4-f9fd820f519d tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 200 len: 1513 microversion: 2.1 time: 0.098732 Oct 05 20:29:07.306244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 500/1027] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:07 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 1513 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:07.326523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-f6918e8e-bff6-4e78-8151-9aa65e912179 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] HTTP exception thrown: Volume tempest-invalid-1668113152 could not be found. Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f6918e8e-bff6-4e78-8151-9aa65e912179 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Request method failure captured: Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1668113152 HTTP/1.1 Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPekSKpPuUF37cK_JipRMgCI_1dkrWwJTe4GV551Daug5Nxf4t9D1X-TeUQMGlIAQMR30Rv3axWj0EFtcqi9HXFF9YmjqRaPohuSVZtl_JM4BubcG3i4zDhv5lFICw2LA7JqmbCIXWALa_qPogtK4QlvcW-LawctuwYe-WiYgqL7rwrQ Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:07.328524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 97c9af8fba58431ea75a34fd6ed4af31 Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Volume tempest-invalid-1668113152 could not be found. Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'tempest-invalid-1668113152'} Oct 05 20:29:07.330088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1668113152 could not be found. (HTTP 404) (Request-ID: req-076676d6-8775-4517-81d4-26b6d368b8e6) Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.330985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 20:29:07.332908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1668113152 could not be found. Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:07.334739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1668113152 could not be found. Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1668113152 could not be found. Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f6918e8e-bff6-4e78-8151-9aa65e912179 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Returning 404 to user: Volume tempest-invalid-1668113152 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f6918e8e-bff6-4e78-8151-9aa65e912179 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1668113152" status: 404 len: 99 microversion: 2.1 time: 0.040709 Oct 05 20:29:07.336325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 528/1028] 10.222.0.23 () {58 vars in 1218 bytes} [Wed Oct 5 20:29:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1668113152 => generated 99 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 20:29:07.341365 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c545695b-5471-47e7-a05e-2c6241e18f4a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004733 Oct 05 20:29:07.341891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 501/1029] 10.222.0.23 () {58 vars in 1140 bytes} [Wed Oct 5 20:29:07 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 20:29:07.350373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0ad68668-5e1a-48f5-811a-3d2d1f48a0b7 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003753 Oct 05 20:29:07.350863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 529/1030] 10.222.0.23 () {58 vars in 1137 bytes} [Wed Oct 5 20:29:07 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 20:29:07.358799 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-61727535-a8d0-4a17-b9f4-d42057ed5b69 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Calling method '.version_select at 0x7f3e026589d0>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:07.389877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-61727535-a8d0-4a17-b9f4-d42057ed5b69 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] HTTP exception thrown: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-61727535-a8d0-4a17-b9f4-d42057ed5b69 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Request method failure captured: Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: DELETE /compute/v2.1/os-volumes/c723cf4f-5f0e-4aff-a5f3-e4d831d291df HTTP/1.1 Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPekSKpPuUF37cK_JipRMgCI_1dkrWwJTe4GV551Daug5Nxf4t9D1X-TeUQMGlIAQMR30Rv3axWj0EFtcqi9HXFF9YmjqRaPohuSVZtl_JM4BubcG3i4zDhv5lFICw2LA7JqmbCIXWALa_qPogtK4QlvcW-LawctuwYe-WiYgqL7rwrQ Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:07.392320 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 97c9af8fba58431ea75a34fd6ed4af31 Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'c723cf4f-5f0e-4aff-a5f3-e4d831d291df'} Oct 05 20:29:07.394257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. (HTTP 404) (Request-ID: req-d4821f83-2b89-403d-a9ff-0103dee877dd) Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.396314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 20:29:07.398374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 20:29:07.400725 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-61727535-a8d0-4a17-b9f4-d42057ed5b69 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Returning 404 to user: Volume c723cf4f-5f0e-4aff-a5f3-e4d831d291df could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-61727535-a8d0-4a17-b9f4-d42057ed5b69 tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/c723cf4f-5f0e-4aff-a5f3-e4d831d291df" status: 404 len: 109 microversion: 2.1 time: 0.043922 Oct 05 20:29:07.403688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 502/1031] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:29:07 2022] DELETE /compute/v2.1/os-volumes/c723cf4f-5f0e-4aff-a5f3-e4d831d291df => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:07.412545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ddb7265d-41ef-47d2-8d12-a76d52197f2a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Calling method '.version_select at 0x7f3e026e0f70>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:07.445426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-ddb7265d-41ef-47d2-8d12-a76d52197f2a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] HTTP exception thrown: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ddb7265d-41ef-47d2-8d12-a76d52197f2a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Request method failure captured: Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/os-volumes/575c2de8-ddd4-488c-8eda-0f7d8a00c042 HTTP/1.1 Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPekSKpPuUF37cK_JipRMgCI_1dkrWwJTe4GV551Daug5Nxf4t9D1X-TeUQMGlIAQMR30Rv3axWj0EFtcqi9HXFF9YmjqRaPohuSVZtl_JM4BubcG3i4zDhv5lFICw2LA7JqmbCIXWALa_qPogtK4QlvcW-LawctuwYe-WiYgqL7rwrQ Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:07.447493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/4fb54ea7a0034a22a2a921af29326e85"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 4fb54ea7a0034a22a2a921af29326e85 Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-VolumesNegativeTest-159660778 Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 97c9af8fba58431ea75a34fd6ed4af31 Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-VolumesNegativeTest-159660778-project Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '575c2de8-ddd4-488c-8eda-0f7d8a00c042'} Oct 05 20:29:07.449015 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. (HTTP 404) (Request-ID: req-a4afe1e2-3bb4-4da2-b4fd-50c29129b55b) Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.449872 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 20:29:07.451003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 20:29:07.452088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ddb7265d-41ef-47d2-8d12-a76d52197f2a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] Returning 404 to user: Volume 575c2de8-ddd4-488c-8eda-0f7d8a00c042 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ddb7265d-41ef-47d2-8d12-a76d52197f2a tempest-VolumesNegativeTest-159660778 tempest-VolumesNegativeTest-159660778-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/575c2de8-ddd4-488c-8eda-0f7d8a00c042" status: 404 len: 109 microversion: 2.1 time: 0.041552 Oct 05 20:29:07.453169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 530/1032] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:29:07 2022] GET /compute/v2.1/os-volumes/575c2de8-ddd4-488c-8eda-0f7d8a00c042 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:08.319794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:08.321187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] [instance: b83ee763-3577-4268-8b24-a16c4b106432] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:08.327408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.328096 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.328652 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.329416 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.330231 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.330738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.348339 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] HTTP exception thrown: Instance b83ee763-3577-4268-8b24-a16c4b106432 could not be found. Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Request method failure captured: Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 HTTP/1.1 Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPeh1kfWOaj9UMrE2ycvlmDMl7aBmcG51HkS5shBuBpFbRgyVhzj_pE184OsgWD2hQG_AzwOT2GRTitLImvgRANB2T-4dw_3YLo27vBtgqeTpODVA2RD4B3PQij6wd0vj3FFfazUYDg73eQNitYS_nENG_SXBZXndjor1EpIKzz2UZ4I Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 5d5f5bc40cdc4be792aff778d3020c6d Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-TestMinimumBasicScenario-1703303721 Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:08.350134 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/5d5f5bc40cdc4be792aff778d3020c6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-TestMinimumBasicScenario-1703303721 Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 5d5f5bc40cdc4be792aff778d3020c6d Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1703303721 Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-TestMinimumBasicScenario-1703303721-project Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 5500db61c95f4245945784ae6b13f197 Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-TestMinimumBasicScenario-1703303721-project Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance b83ee763-3577-4268-8b24-a16c4b106432 could not be found. Oct 05 20:29:08.351537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'b83ee763-3577-4268-8b24-a16c4b106432'} Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b83ee763-3577-4268-8b24-a16c4b106432 could not be found. Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:08.352260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b83ee763-3577-4268-8b24-a16c4b106432 could not be found. Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b83ee763-3577-4268-8b24-a16c4b106432 could not be found. Oct 05 20:29:08.353605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:08.356811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Returning 404 to user: Instance b83ee763-3577-4268-8b24-a16c4b106432 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:08.358351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bedb8173-74d1-42b9-8275-3126cd399359 tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432" status: 404 len: 111 microversion: 2.1 time: 0.042753 Oct 05 20:29:08.359100 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 503/1033] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:08 2022] GET /compute/v2.1/servers/b83ee763-3577-4268-8b24-a16c4b106432 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:29:08.368985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3d69615d-f1bd-44d8-b09c-0c632e5a7bea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] Calling method '.version_select at 0x7f3e026e1c10>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:08.389286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3d69615d-f1bd-44d8-b09c-0c632e5a7bea tempest-TestMinimumBasicScenario-1703303721 tempest-TestMinimumBasicScenario-1703303721-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1678459228" status: 202 len: 0 microversion: 2.1 time: 0.025599 Oct 05 20:29:08.390286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 531/1034] 10.222.0.23 () {58 vars in 1272 bytes} [Wed Oct 5 20:29:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1678459228 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:29:08.396712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:08.399032 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:08.405048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.405562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.406007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.406952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.407925 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.408367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.451726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-60a598e7-a499-43a4-bbea-e115100bf468 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060070 Oct 05 20:29:08.452290 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 504/1035] 10.222.0.23 () {60 vars in 1343 bytes} [Wed Oct 5 20:29:08 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:29:08.518727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:08.520136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:08.526787 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.527279 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.527714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.528403 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.528854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.529270 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.563070 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:29:08.649448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3cfb594d-dd29-4a5b-9557-a3d2d1357a0c tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 204 len: 0 microversion: 2.20 time: 0.134367 Oct 05 20:29:08.653256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 532/1036] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Oct 5 20:29:08 2022] DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 20:29:08.662587 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:08.663166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:08.669054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.669570 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.670005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.670712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:08.671353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:08.671782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:08.842507 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:08.852342 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:08.853838 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:08.855089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c69e3b89-9c54-4e63-9399-349bff7fb0dd tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.199855 Oct 05 20:29:08.855716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 505/1037] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:08 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:29:09.885047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:09.885905 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:09.896973 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:09.897499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:09.897944 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:09.898656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:09.899117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:09.899568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:10.116982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:10.128486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:10.131316 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:10.132754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-80ea360b-f2bd-4e41-bacf-86acc63f65f8 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.252204 Oct 05 20:29:10.133493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 533/1038] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:09 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:29:11.157984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:11.158600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:11.172648 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:11.175683 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:11.177706 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:11.179138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:11.179828 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:11.180597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:11.372811 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:11.383498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:11.385589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:11.387261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e1ce1e6b-c0fc-432f-b3f8-8fd355a30eb9 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1721 microversion: 2.20 time: 0.232988 Oct 05 20:29:11.405210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 506/1039] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:11 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1721 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:29:11.985230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-dc72627d-4a9e-403b-96af-e5e5c9b7df84 req-034361f3-d954-43ec-bd44-bfff385268cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4afc70e1-0337-42dd-9976-27f07f9baff3", "name": "network-vif-deleted", "tag": "938a7d9f-3a0f-4c79-80ef-ca3e36f0894f"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:12.005793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-dc72627d-4a9e-403b-96af-e5e5c9b7df84 req-034361f3-d954-43ec-bd44-bfff385268cf service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:12.006567 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-dc72627d-4a9e-403b-96af-e5e5c9b7df84 req-034361f3-d954-43ec-bd44-bfff385268cf service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:12.007170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-dc72627d-4a9e-403b-96af-e5e5c9b7df84 req-034361f3-d954-43ec-bd44-bfff385268cf service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:12.020371 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-dc72627d-4a9e-403b-96af-e5e5c9b7df84 req-034361f3-d954-43ec-bd44-bfff385268cf service nova] Creating event network-vif-deleted:938a7d9f-3a0f-4c79-80ef-ca3e36f0894f for instance 4afc70e1-0337-42dd-9976-27f07f9baff3 on hv-cinder-80152 Oct 05 20:29:12.028417 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-dc72627d-4a9e-403b-96af-e5e5c9b7df84 req-034361f3-d954-43ec-bd44-bfff385268cf service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046929 Oct 05 20:29:12.030322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 534/1040] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:12.412178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:12.413427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:12.421986 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:12.422486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:12.422939 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:12.423649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:12.424110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:12.424535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:12.477327 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:12.479000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:12.481792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:12.482392 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lazy-loading 'fault' on Instance uuid 4afc70e1-0337-42dd-9976-27f07f9baff3 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:29:12.545595 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:12.558702 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:12.560963 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ff9b14ab630d4a928614c60e6aea667c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140a5d8a1d264d8bad17d352591fa6a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:12.563537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f04b53eb-a77f-4d44-b428-01de97a923e1 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 200 len: 1371 microversion: 2.20 time: 0.154104 Oct 05 20:29:12.564635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 507/1041] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:12 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 20:29:13.600145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:13.600837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:13.608085 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:13.608574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:13.609199 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:13.609933 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:13.610549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:13.610974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:13.627580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] HTTP exception thrown: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Request method failure captured: Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 HTTP/1.1 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedkxH_NsdNSwvc5RM3B4vez13DF2iEJPc03yAp9Om7qarEp2P2GFMkPnzsIrkxDCkdW0UTAZRxMKxKNUs28NV5Vws9rYpjj72OReze3Xil3Iot1qmwv6oCVsAP20ZyznFoje8h4JMB8i1mN2PsFBhVUKqjraDkhS9Z38JJmSy6uJiI Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:13.630025 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: ff9b14ab630d4a928614c60e6aea667c Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:13.631652 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '4afc70e1-0337-42dd-9976-27f07f9baff3'} Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:13.632428 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:13.634931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:13.638512 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Returning 404 to user: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:13.638512 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ec3b8ae5-0e94-44df-ba89-81518cbf5aaa tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 404 len: 111 microversion: 2.20 time: 0.037777 Oct 05 20:29:13.638512 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 535/1042] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:13 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:13.642810 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-617bc3a6-603b-4fbf-ad34-944e31350f08 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '.version_select at 0x7f3e0256a670>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:13.665611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-617bc3a6-603b-4fbf-ad34-944e31350f08 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-752461285" status: 204 len: 0 microversion: 2.20 time: 0.026974 Oct 05 20:29:13.666491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 508/1043] 10.222.0.23 () {60 vars in 1259 bytes} [Wed Oct 5 20:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-752461285 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 20:29:15.455534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:15.456477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:15.459777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:29:15.465408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:15.466265 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:15.466806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:15.467668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:15.468220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:15.468746 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:15.485303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] HTTP exception thrown: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Request method failure captured: Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 HTTP/1.1 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedkxH_NsdNSwvc5RM3B4vez13DF2iEJPc03yAp9Om7qarEp2P2GFMkPnzsIrkxDCkdW0UTAZRxMKxKNUs28NV5Vws9rYpjj72OReze3Xil3Iot1qmwv6oCVsAP20ZyznFoje8h4JMB8i1mN2PsFBhVUKqjraDkhS9Z38JJmSy6uJiI Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:15.487325 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: ff9b14ab630d4a928614c60e6aea667c Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.489103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '4afc70e1-0337-42dd-9976-27f07f9baff3'} Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:15.490044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.491510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.492990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Returning 404 to user: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:15.493656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-bce8f49b-baa7-4675-ac37-2582884459b0 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 404 len: 111 microversion: 2.20 time: 0.042135 Oct 05 20:29:15.494536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 536/1044] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Oct 5 20:29:15 2022] DELETE /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:15.502704 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:15.503336 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 4afc70e1-0337-42dd-9976-27f07f9baff3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:15.511639 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:15.512202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:15.512575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:15.513283 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:15.514016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:15.514496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:15.529247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] HTTP exception thrown: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Request method failure captured: Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 HTTP/1.1 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedkxH_NsdNSwvc5RM3B4vez13DF2iEJPc03yAp9Om7qarEp2P2GFMkPnzsIrkxDCkdW0UTAZRxMKxKNUs28NV5Vws9rYpjj72OReze3Xil3Iot1qmwv6oCVsAP20ZyznFoje8h4JMB8i1mN2PsFBhVUKqjraDkhS9Z38JJmSy6uJiI Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:15.531331 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: ff9b14ab630d4a928614c60e6aea667c Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.533016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '4afc70e1-0337-42dd-9976-27f07f9baff3'} Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:15.533870 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. Oct 05 20:29:15.535340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:15.536567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Returning 404 to user: Instance 4afc70e1-0337-42dd-9976-27f07f9baff3 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:15.536567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1baa182a-7046-4477-a761-27d451dd0e3a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3" status: 404 len: 111 microversion: 2.20 time: 0.034029 Oct 05 20:29:15.536567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 509/1045] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:15 2022] GET /compute/v2.1/servers/4afc70e1-0337-42dd-9976-27f07f9baff3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:16.693775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:16.694357 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:16.702003 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:16.703071 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:16.703642 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:16.704461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:16.704982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:16.705476 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:16.720720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] HTTP exception thrown: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Request method failure captured: Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 HTTP/1.1 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPedkxH_NsdNSwvc5RM3B4vez13DF2iEJPc03yAp9Om7qarEp2P2GFMkPnzsIrkxDCkdW0UTAZRxMKxKNUs28NV5Vws9rYpjj72OReze3Xil3Iot1qmwv6oCVsAP20ZyznFoje8h4JMB8i1mN2PsFBhVUKqjraDkhS9Z38JJmSy6uJiI Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:16.723009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: ff9b14ab630d4a928614c60e6aea667c Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.724634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '1f20ad33-5d0e-4324-b1b5-c8f823457933'} Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:16.725551 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.727526 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.728784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Returning 404 to user: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:16.728784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d33a80d5-322a-40c9-9de3-134bc84d9d9a tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 404 len: 111 microversion: 2.20 time: 0.036879 Oct 05 20:29:16.728784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 537/1046] 10.222.0.23 () {60 vars in 1280 bytes} [Wed Oct 5 20:29:16 2022] DELETE /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:16.735675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:16.736291 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] [instance: 1f20ad33-5d0e-4324-b1b5-c8f823457933] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:16.743012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:16.743503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:16.743944 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:16.744645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:16.745104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:16.745557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:16.759552 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] HTTP exception thrown: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Request method failure captured: Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 HTTP/1.1 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPedkxH_NsdNSwvc5RM3B4vez13DF2iEJPc03yAp9Om7qarEp2P2GFMkPnzsIrkxDCkdW0UTAZRxMKxKNUs28NV5Vws9rYpjj72OReze3Xil3Iot1qmwv6oCVsAP20ZyznFoje8h4JMB8i1mN2PsFBhVUKqjraDkhS9Z38JJmSy6uJiI Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:16.761090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/140a5d8a1d264d8bad17d352591fa6a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 140a5d8a1d264d8bad17d352591fa6a2 Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1633485442 Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: ff9b14ab630d4a928614c60e6aea667c Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1633485442-project Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.763161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '1f20ad33-5d0e-4324-b1b5-c8f823457933'} Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:16.764019 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. Oct 05 20:29:16.765955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:16.767399 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] Returning 404 to user: Instance 1f20ad33-5d0e-4324-b1b5-c8f823457933 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:16.767399 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c4333242-4405-47f3-b4dc-f93fcc5246f4 tempest-AttachVolumeShelveTestJSON-1633485442 tempest-AttachVolumeShelveTestJSON-1633485442-project] 10.222.0.23 "GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933" status: 404 len: 111 microversion: 2.20 time: 0.030770 Oct 05 20:29:16.767399 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 510/1047] 10.222.0.23 () {60 vars in 1277 bytes} [Wed Oct 5 20:29:16 2022] GET /compute/v2.1/servers/1f20ad33-5d0e-4324-b1b5-c8f823457933 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 20:29:23.015260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b2ca72b6-6114-43c3-8e10-90417c01002e tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e05e36790>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:23.063935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b2ca72b6-6114-43c3-8e10-90417c01002e tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/6386217f-4162-4204-81d4-e5f441846933" status: 200 len: 350 microversion: 2.1 time: 0.052412 Oct 05 20:29:23.064587 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 538/1048] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:29:23 2022] GET /compute/v2.1/os-volumes/6386217f-4162-4204-81d4-e5f441846933 => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:24.425936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-04735d28-0d5b-40ca-8b5a-3ab12f7f135f tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e0266f700>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:24.474973 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-04735d28-0d5b-40ca-8b5a-3ab12f7f135f tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/02a466bf-ddc8-44c9-9072-942863189672" status: 200 len: 351 microversion: 2.1 time: 0.052710 Oct 05 20:29:24.475535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 511/1049] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:29:24 2022] GET /compute/v2.1/os-volumes/02a466bf-ddc8-44c9-9072-942863189672 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:29:25.816404 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-72d69dcd-25fc-444e-8c9a-02168d41c788 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e05e853a0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:25.871486 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-72d69dcd-25fc-444e-8c9a-02168d41c788 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/8a1ea0d7-5e32-479d-b933-68c668a2c47d" status: 200 len: 351 microversion: 2.1 time: 0.060331 Oct 05 20:29:25.872286 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 539/1050] 10.222.0.23 () {58 vars in 1245 bytes} [Wed Oct 5 20:29:25 2022] GET /compute/v2.1/os-volumes/8a1ea0d7-5e32-479d-b933-68c668a2c47d => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:25.886940 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f423e077-4e11-4896-a89e-f16406319b49 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e0271a430>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:25.969838 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f423e077-4e11-4896-a89e-f16406319b49 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087077 Oct 05 20:29:25.970402 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 512/1051] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Oct 5 20:29:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:25.984181 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ac11d0fd-fbe3-4cae-9bc5-e40350282afb tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e026e69d0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.068838 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ac11d0fd-fbe3-4cae-9bc5-e40350282afb tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088287 Oct 05 20:29:26.069400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 540/1052] 10.222.0.23 () {58 vars in 1149 bytes} [Wed Oct 5 20:29:25 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:26.083092 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a0a598aa-52fb-422e-b7e2-60363014554e tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e025d91f0>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.162612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a0a598aa-52fb-422e-b7e2-60363014554e tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083178 Oct 05 20:29:26.163178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 513/1053] 10.222.0.23 () {58 vars in 1134 bytes} [Wed Oct 5 20:29:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:26.176857 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-eb3e43d5-a385-441b-8b7e-610395c1b78a tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e05e36700>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.256827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-eb3e43d5-a385-441b-8b7e-610395c1b78a tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084221 Oct 05 20:29:26.257389 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 541/1054] 10.222.0.23 () {58 vars in 1167 bytes} [Wed Oct 5 20:29:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:26.270804 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-142bde08-0bc6-4e44-8c7f-e550d4e362a6 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e02726f70>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.351440 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-142bde08-0bc6-4e44-8c7f-e550d4e362a6 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084332 Oct 05 20:29:26.352046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 514/1055] 10.222.0.23 () {58 vars in 1170 bytes} [Wed Oct 5 20:29:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:26.366506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-afa6f3ec-341a-4b6d-8125-b3ac356fa6f8 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e02873700>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.445817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-afa6f3ec-341a-4b6d-8125-b3ac356fa6f8 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083579 Oct 05 20:29:26.446409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 542/1056] 10.222.0.23 () {58 vars in 1155 bytes} [Wed Oct 5 20:29:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:26.460277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ce81fc2a-ef6f-4a4b-bf46-78fe24512ec9 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e024d4040>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.542773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ce81fc2a-ef6f-4a4b-bf46-78fe24512ec9 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086646 Oct 05 20:29:26.543378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 515/1057] 10.222.0.23 () {58 vars in 1188 bytes} [Wed Oct 5 20:29:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:26.556608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6e4b5f7c-c2b5-4cf0-b8f7-c8a8e1325d40 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] Calling method '.version_select at 0x7f3e05e7be50>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:26.638489 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6e4b5f7c-c2b5-4cf0-b8f7-c8a8e1325d40 tempest-VolumesTestJSON-855038945 tempest-VolumesTestJSON-855038945-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.085500 Oct 05 20:29:26.639053 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 543/1058] 10.222.0.23 () {58 vars in 1155 bytes} [Wed Oct 5 20:29:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:34.938475 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:29:34.939792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:29:34.945377 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:34.945849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:34.953636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:34.954319 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:34.954971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:34.955798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:34.956540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:34.957037 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:34.983406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-46bfce68-28f8-4e5e-8657-82f2187e8eb7 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/ips" status: 200 len: 150 microversion: 2.1 time: 0.045780 Oct 05 20:29:34.983981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 516/1059] 10.222.0.23 () {58 vars in 1248 bytes} [Wed Oct 5 20:29:34 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:36.366700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:29:36.368205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:29:36.373115 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fc0ac24-9aa0-45b8-83c9-d410b2351666"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:36.375860 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:36.383765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:36.384260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:36.384710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:36.385753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:36.386220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:36.386648 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:36.679856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-28bc43b2-6bfe-4584-a809-6ee179caa86e tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "POST /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313586 Oct 05 20:29:36.681001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 544/1060] 10.222.0.23 () {60 vars in 1323 bytes} [Wed Oct 5 20:29:36 2022] POST /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:44.436369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:44.436912 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:44.443161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:44.443642 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:44.444264 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:44.444961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:44.445414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:44.445865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:44.570148 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lazy-loading 'services' on Instance uuid eb4be578-f1f8-4c59-8cd6-80a0cd591484 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:29:44.671417 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7a7de41d-5cb3-4f9c-ad19-15d3134723eb tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments/6fc0ac24-9aa0-45b8-83c9-d410b2351666" status: 202 len: 0 microversion: 2.1 time: 0.238947 Oct 05 20:29:44.672472 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 517/1061] 10.222.0.23 () {58 vars in 1416 bytes} [Wed Oct 5 20:29:44 2022] DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments/6fc0ac24-9aa0-45b8-83c9-d410b2351666 => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:29:44.683246 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:44.687811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:44.696630 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:44.697234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:44.697788 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:44.698562 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:44.699092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:44.699591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:44.731622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2cccdb5c-bd36-4d4e-aa0d-5a5dd5287797 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053582 Oct 05 20:29:44.732443 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 545/1062] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:29:44 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:45.746289 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:45.748562 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:45.755040 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:45.755762 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:45.756206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:45.756915 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:45.757550 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:45.758156 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:45.804721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d001fc24-f83c-4ee5-9ee8-d759039b021d tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063375 Oct 05 20:29:45.805404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 518/1063] 10.222.0.23 () {58 vars in 1302 bytes} [Wed Oct 5 20:29:45 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 20:29:45.874831 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:45.875990 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:45.885360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:45.885886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:45.886322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:45.887211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:45.887829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:45.888255 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:45.921247 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:29:46.027445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-49b5aab4-470f-460b-88be-d8576456264f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 204 len: 0 microversion: 2.1 time: 0.157462 Oct 05 20:29:46.028658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 546/1064] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:45 2022] DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:29:46.038117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:46.038825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:46.046217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:46.046794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:46.047298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:46.048298 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:46.049405 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:46.050171 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:46.270363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:46.281310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-12ded29d-799b-4e28-9474-e37a98b524a1 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1681 microversion: 2.1 time: 0.247937 Oct 05 20:29:46.282413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 519/1065] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:46 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:47.308661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:47.309485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:47.316772 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:47.317984 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:47.318179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:47.318974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:47.319513 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:47.320077 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:47.518259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:47.550297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3456fa5f-d802-48ae-9e10-a7104c4d4f8f tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1681 microversion: 2.1 time: 0.247285 Oct 05 20:29:47.550930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 547/1066] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:47 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1681 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:48.574496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:48.575127 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:48.583871 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:48.588716 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:48.591700 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:48.592926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:48.595125 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:48.595792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:48.710313 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d2803e109849fda2828f66f51b8a0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05398ef99be34b57b61052a0f07f57f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:29:48.721021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3074e6e1-3bde-47e5-9b8a-44ae7f46fd30 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 200 len: 1614 microversion: 2.1 time: 0.149986 Oct 05 20:29:48.739613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 520/1067] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:48 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 1614 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:29:48.963042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-2352ac1a-6129-4089-8ca1-1dd6515f3613 req-1a1fd892-9045-4883-a11d-f9f6d08059a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb4be578-f1f8-4c59-8cd6-80a0cd591484", "name": "network-vif-deleted", "tag": "eb9eff72-e2d3-4280-8fef-24864fd828f9"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:48.997609 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-2352ac1a-6129-4089-8ca1-1dd6515f3613 req-1a1fd892-9045-4883-a11d-f9f6d08059a1 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:48.998497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-2352ac1a-6129-4089-8ca1-1dd6515f3613 req-1a1fd892-9045-4883-a11d-f9f6d08059a1 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:48.999305 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-2352ac1a-6129-4089-8ca1-1dd6515f3613 req-1a1fd892-9045-4883-a11d-f9f6d08059a1 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:49.030217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-2352ac1a-6129-4089-8ca1-1dd6515f3613 req-1a1fd892-9045-4883-a11d-f9f6d08059a1 service nova] Creating event network-vif-deleted:eb9eff72-e2d3-4280-8fef-24864fd828f9 for instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 on hv-cinder-80152 Oct 05 20:29:49.040334 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-2352ac1a-6129-4089-8ca1-1dd6515f3613 req-1a1fd892-9045-4883-a11d-f9f6d08059a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081579 Oct 05 20:29:49.042731 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 548/1068] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:49.747732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:49.748359 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:49.760842 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:49.761669 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:49.762465 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:49.769999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:49.771372 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:49.771985 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:49.795764 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 HTTP/1.1 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:49.797446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:49.799112 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'eb4be578-f1f8-4c59-8cd6-80a0cd591484'} Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:49.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:49.801825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:49.804727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:49.804727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-959168b7-c840-4be6-9aed-c21376213d98 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 404 len: 111 microversion: 2.1 time: 0.059742 Oct 05 20:29:49.804727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 521/1069] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:49 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:49.813190 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fda0a5b2-78cd-4226-836a-bdc9ce3989f8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '.version_select at 0x7f3e05e7ba60>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:49.849596 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fda0a5b2-78cd-4226-836a-bdc9ce3989f8 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644500392" status: 202 len: 0 microversion: 2.1 time: 0.040603 Oct 05 20:29:49.861683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 549/1070] 10.222.0.23 () {58 vars in 1221 bytes} [Wed Oct 5 20:29:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1644500392 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:29:52.299109 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:52.299646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:52.306924 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:52.307699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:52.308306 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:52.309034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:52.309543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:52.309981 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:52.326543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 HTTP/1.1 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:52.328128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.329500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'eb4be578-f1f8-4c59-8cd6-80a0cd591484'} Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:52.334757 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.336087 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.337433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:52.337433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cd8fa7b4-d337-4c84-9f69-741263b75eda tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 404 len: 111 microversion: 2.1 time: 0.035432 Oct 05 20:29:52.337433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 522/1071] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:52 2022] DELETE /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:52.339044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:52.339914 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: eb4be578-f1f8-4c59-8cd6-80a0cd591484] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:52.351225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:52.351767 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:52.352217 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:52.352967 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:52.353444 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:52.354047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:52.369782 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 HTTP/1.1 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:52.378036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.380292 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'eb4be578-f1f8-4c59-8cd6-80a0cd591484'} Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:52.384361 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. Oct 05 20:29:52.385856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:52.387461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance eb4be578-f1f8-4c59-8cd6-80a0cd591484 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:52.387461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f507b0ec-1198-4ba3-96ab-279d7027c6da tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484" status: 404 len: 111 microversion: 2.1 time: 0.045040 Oct 05 20:29:52.387461 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 550/1072] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:52 2022] GET /compute/v2.1/servers/eb4be578-f1f8-4c59-8cd6-80a0cd591484 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:53.609246 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:53.610366 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:53.622168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.622168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.622168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.622168 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.622577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.623174 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.640753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 HTTP/1.1 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:53.642406 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.643883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'c26f72d3-ab1b-472f-9551-b044693c2168'} Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:53.648441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.649733 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.651491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:53.651491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-15e8d547-c488-42f0-9c47-fe631b625e19 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 404 len: 111 microversion: 2.1 time: 0.038929 Oct 05 20:29:53.651491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 523/1073] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:53 2022] DELETE /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:53.653057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:53.669106 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: c26f72d3-ab1b-472f-9551-b044693c2168] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:53.684459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.685122 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.685753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.686608 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.688138 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.688824 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.707018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 HTTP/1.1 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:53.708848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.710230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'c26f72d3-ab1b-472f-9551-b044693c2168'} Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:53.711136 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. Oct 05 20:29:53.712598 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.727721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance c26f72d3-ab1b-472f-9551-b044693c2168 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:53.728732 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d08e5846-1421-48a5-aeea-cc8641f3ec37 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168" status: 404 len: 111 microversion: 2.1 time: 0.079495 Oct 05 20:29:53.729545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 551/1074] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:53 2022] GET /compute/v2.1/servers/c26f72d3-ab1b-472f-9551-b044693c2168 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:53.737210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:53.738081 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:53.744135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.744655 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.745084 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.745817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.746268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.746686 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.761001 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: DELETE /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 HTTP/1.1 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:53.762673 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.764312 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '6bd5c8f4-254b-4924-a74a-8f5b8f190b48'} Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:53.768363 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.771000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.773106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:53.773106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-4a6b84f9-266c-48b6-ba33-cea5ce8c8006 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 404 len: 111 microversion: 2.1 time: 0.030661 Oct 05 20:29:53.773106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 524/1075] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:53 2022] DELETE /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:29:53.773360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:53.773803 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: 6bd5c8f4-254b-4924-a74a-8f5b8f190b48] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:53.779769 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.780261 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.780692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.781602 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:53.782044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:53.782468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:53.798363 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 HTTP/1.1 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:53.800364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.801799 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '6bd5c8f4-254b-4924-a74a-8f5b8f190b48'} Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:53.802590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. Oct 05 20:29:53.803966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:53.805065 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance 6bd5c8f4-254b-4924-a74a-8f5b8f190b48 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:53.805065 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-54789e25-9a7b-4e0b-8f56-3cc34d28d77a tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48" status: 404 len: 111 microversion: 2.1 time: 0.033414 Oct 05 20:29:53.806549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 552/1076] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:53 2022] GET /compute/v2.1/servers/6bd5c8f4-254b-4924-a74a-8f5b8f190b48 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:29:54.150182 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-573b2d7a-6672-4fac-87e2-0c71119d7eed tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Action: 'create', calling method: .version_select at 0x7f3e028af9d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-678612123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxjFDP9fOnUQape1jokF1uO2ybRLk7vKBxhZVbnJOfaSSc/fyc8jRZeEedzGLvM9DMzCAcJqJTfUVMl5OVMU2t4DbZL9W16apqQqOwP0d2cu2HyBFQrHd2nQxkUg+cWbw=="}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:29:54.167113 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-573b2d7a-6672-4fac-87e2-0c71119d7eed tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Getting quotas for project 3277eaeb27724447a3864927021c2b79. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:29:54.171080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-573b2d7a-6672-4fac-87e2-0c71119d7eed tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Getting quotas for user b7b64272dd774de5a7cd22776df18eca and project 3277eaeb27724447a3864927021c2b79. Resources: {'key_pairs'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:29:54.198285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-573b2d7a-6672-4fac-87e2-0c71119d7eed tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.298933 Oct 05 20:29:54.205204 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 525/1077] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:29:53 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:29:54.964016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:54.965505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:54.973946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:54.974692 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:54.975378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:54.976866 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:54.978106 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:54.978807 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:55.010096 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 HTTP/1.1 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:29:55.016083 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.017765 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'd4189131-495b-4d78-9eb7-b69ea29c7b50'} Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:55.018699 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.020716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.024010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:55.025066 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-30f3cff5-d81d-4fab-9b20-d1085a2fe2c0 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 404 len: 111 microversion: 2.1 time: 0.065064 Oct 05 20:29:55.030035 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 553/1078] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:29:54 2022] DELETE /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:29:55.039902 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:29:55.041189 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] [instance: d4189131-495b-4d78-9eb7-b69ea29c7b50] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:29:55.059233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:55.060849 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:55.061577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:55.063949 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:29:55.064962 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:29:55.066149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:29:55.085854 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] HTTP exception thrown: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Request method failure captured: Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 HTTP/1.1 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPefJddPY01KUwPnuWIcTI7_VAoRYNaXl-rNysYDom5hjbR5FCH-UPUenELRG5-CvPuzFsQj8rjcfsqT264eegJytgFKiI7sLaNrDCqmhBZrOC1noC7o45dUZGVwdcGe6I32GisE3wQpT_kFB_iK2RST3YlNqdVXC_EciA9ugA4xApU4 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:29:55.087695 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/05398ef99be34b57b61052a0f07f57f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 05398ef99be34b57b61052a0f07f57f8 Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1383459491 Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 10d2803e109849fda2828f66f51b8a0c Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-AttachVolumeNegativeTest-1383459491-project Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.089079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'd4189131-495b-4d78-9eb7-b69ea29c7b50'} Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:29:55.089945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. Oct 05 20:29:55.091153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:29:55.093950 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] Returning 404 to user: Instance d4189131-495b-4d78-9eb7-b69ea29c7b50 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:29:55.095211 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bdb27e34-bbf1-4662-8390-dc1cb538e092 tempest-AttachVolumeNegativeTest-1383459491 tempest-AttachVolumeNegativeTest-1383459491-project] 10.222.0.23 "GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50" status: 404 len: 111 microversion: 2.1 time: 0.061242 Oct 05 20:29:55.114292 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 526/1079] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:29:55 2022] GET /compute/v2.1/servers/d4189131-495b-4d78-9eb7-b69ea29c7b50 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:30:14.162140 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-951134272", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-678612123", "security_groups": [{"name": "tempest-secgroup-smoke-314677540"}], "networks": [{"uuid": "ee6333db-3e50-4178-bd81-2717c05d02a7"}], "block_device_mapping_v2": [{"uuid": "f56c06c9-ef5f-43c2-8ec6-7ce9711ee431", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:14.176022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:14.177750 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:14.287962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] validate_networks() for [('ee6333db-3e50-4178-bd81-2717c05d02a7', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:30:14.689356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:30:14.689908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:30:14.690561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:30:14.690982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:30:14.691395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:30:14.701625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:14.702192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:14.702658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:14.703390 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:14.703874 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:14.704299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:14.721827 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Getting quotas for project 3277eaeb27724447a3864927021c2b79. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:30:14.725788 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Getting quotas for user b7b64272dd774de5a7cd22776df18eca and project 3277eaeb27724447a3864927021c2b79. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:30:14.784171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:30:14.786360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f56c06c9-ef5f-43c2-8ec6-7ce9711ee431',volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:30:14.926159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-af3c048d-9034-4c13-83f2-a9bc1ac58fc9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.768453 Oct 05 20:30:14.929677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 554/1080] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:30:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:30:14.938358 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-257a3940-1c66-4ff9-a6d2-218b53e7ddae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:14.939083 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-257a3940-1c66-4ff9-a6d2-218b53e7ddae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:14.945571 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=4 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:14.946232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:14.947266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:15.028412 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-257a3940-1c66-4ff9-a6d2-218b53e7ddae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:15.035691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-257a3940-1c66-4ff9-a6d2-218b53e7ddae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1087 microversion: 2.1 time: 0.101390 Oct 05 20:30:15.037166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 527/1081] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:14 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1087 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:16.061683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:16.062289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:16.069858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:16.070337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:16.071588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:16.072885 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:16.074426 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:16.075418 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:16.190928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:16.216047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7b6e3b64-9f57-40ec-a452-0938f40cff47 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1193 microversion: 2.1 time: 0.159677 Oct 05 20:30:16.219141 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 555/1082] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:16 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1193 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:17.238712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:17.239326 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:17.250387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:17.252079 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:17.254865 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:17.255611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:17.256088 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:17.256546 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:17.424566 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:17.434352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3375ea00-8e41-4f3d-84d7-f842425c187e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.199542 Oct 05 20:30:17.435012 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 528/1083] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:17 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:17.709307 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-85775f76-e0b6-42c5-a89f-51878179cfc1 req-302edd15-602a-4a72-a984-eabc3e490d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:17.719661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-85775f76-e0b6-42c5-a89f-51878179cfc1 req-302edd15-602a-4a72-a984-eabc3e490d15 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:17.720348 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-85775f76-e0b6-42c5-a89f-51878179cfc1 req-302edd15-602a-4a72-a984-eabc3e490d15 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:17.720775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-85775f76-e0b6-42c5-a89f-51878179cfc1 req-302edd15-602a-4a72-a984-eabc3e490d15 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:17.737603 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-85775f76-e0b6-42c5-a89f-51878179cfc1 req-302edd15-602a-4a72-a984-eabc3e490d15 service nova] Creating event network-changed:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:30:17.744421 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-85775f76-e0b6-42c5-a89f-51878179cfc1 req-302edd15-602a-4a72-a984-eabc3e490d15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039464 Oct 05 20:30:17.745386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 556/1084] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:30:18.458994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:18.460247 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:18.466563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:18.467046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:18.467480 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:18.468176 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:18.468631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:18.469053 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:18.601611 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:18.609239 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ca2afc64-58f1-47e7-a28c-89f394c71e61 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.154249 Oct 05 20:30:18.609876 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 529/1085] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:18 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:19.633324 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:19.634058 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:19.640125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:19.640610 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:19.641058 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:19.641777 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:19.642237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:19.642658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:19.788600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:19.796360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-640d6b8e-e9cd-48d8-bdd5-73b18c3f69d9 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.167875 Oct 05 20:30:19.796932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 557/1086] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:19 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:20.819862 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:20.820478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:20.826947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:20.827435 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:20.827883 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:20.828584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:20.829221 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:20.829597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:20.968809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:20.977111 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-49057195-ab68-4a8c-9129-fc86cfa880b1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.161411 Oct 05 20:30:20.977646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 530/1087] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:20 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:22.000499 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:22.001111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:22.008284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:22.008764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:22.009201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:22.009915 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:22.010370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:22.010794 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:22.143743 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:22.151960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-75888154-4697-48b9-a39d-854e1eec636b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.155367 Oct 05 20:30:22.152517 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 558/1088] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:21 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:23.174675 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:23.175287 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:23.182551 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:23.183031 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:23.183466 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:23.184150 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:23.184606 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:23.185027 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:23.317505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:23.325194 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cacb3b59-1cc3-4a25-8791-b40be857493c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.154333 Oct 05 20:30:23.325809 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 531/1089] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:23 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:24.347500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:24.348752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:24.355843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:24.356340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:24.356775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:24.357467 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:24.358042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:24.358471 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:24.492643 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:24.500494 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-930aefc4-a02c-4e77-8305-144019c34779 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.156957 Oct 05 20:30:24.501052 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 559/1090] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:24 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:25.524061 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:25.524679 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:25.527035 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:25.532572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:25.533110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:25.533586 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:25.534291 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:25.534753 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:25.535726 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:25.666201 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:25.674183 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-80d7b66f-3a47-4bed-9aca-c1fecefd003d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.153957 Oct 05 20:30:25.674749 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 532/1091] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:25 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:26.698935 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:26.699553 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:26.703020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:26.705779 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:26.714921 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:26.715300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:26.715873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:26.722223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:26.723961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:26.732215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:26.891952 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:26.901244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dc2c3716-ea58-46c8-97bf-9552862448d1 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.206722 Oct 05 20:30:26.902072 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 560/1092] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:26 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:27.924857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:27.926080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:27.932505 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:27.932966 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:27.933400 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:27.934161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:27.934614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:27.935034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:28.071260 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:28.079158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d20d326d-d456-4b87-bda5-1e8b002c118e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.158431 Oct 05 20:30:28.079807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 533/1093] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:27 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:29.102398 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:29.103005 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:29.111276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:29.111971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:29.112612 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:29.113495 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:29.114037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:29.114592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:29.268225 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:29.277830 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3361c9b2-bad6-4840-80ac-84f8aaba9d0a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.179154 Oct 05 20:30:29.281660 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 561/1094] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:29 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:29.961464 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-e8971e6c-8c6a-4ac2-87ca-1c0a30d5a28d req-69c2624d-b31a-4bb5-b216-309ef46aa1ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "name": "network-vif-plugged", "status": "completed", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:29.972059 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-e8971e6c-8c6a-4ac2-87ca-1c0a30d5a28d req-69c2624d-b31a-4bb5-b216-309ef46aa1ef service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:29.973091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-e8971e6c-8c6a-4ac2-87ca-1c0a30d5a28d req-69c2624d-b31a-4bb5-b216-309ef46aa1ef service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:29.973721 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-e8971e6c-8c6a-4ac2-87ca-1c0a30d5a28d req-69c2624d-b31a-4bb5-b216-309ef46aa1ef service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:29.991696 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-e8971e6c-8c6a-4ac2-87ca-1c0a30d5a28d req-69c2624d-b31a-4bb5-b216-309ef46aa1ef service nova] Creating event network-vif-plugged:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:30:29.997542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-e8971e6c-8c6a-4ac2-87ca-1c0a30d5a28d req-69c2624d-b31a-4bb5-b216-309ef46aa1ef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044352 Oct 05 20:30:29.998719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 534/1095] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:30:30.300966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:30.301829 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:30.308347 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:30.308851 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:30.309422 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:30.310207 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:30.310760 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:30.311176 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:30.453448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:30.462850 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d41c07d1-18b4-452e-8127-66d8e670057a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1258 microversion: 2.1 time: 0.166258 Oct 05 20:30:30.463413 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 562/1096] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:30 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:31.487269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:31.488484 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:31.497689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:31.497689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:31.497689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:31.497689 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:31.498139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:31.498139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:31.647667 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:31.656563 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-d001bad8-ad3e-4974-bb9d-8d16622ed59e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1442 microversion: 2.1 time: 0.174358 Oct 05 20:30:31.657139 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 535/1097] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:31 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1442 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:31.681080 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:31.682300 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:31.688813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:31.689304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:31.689790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:31.690491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:31.690970 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:31.691409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:31.827854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:31.836450 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ff024848-d3b2-40ee-9514-62fb491edd76 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1442 microversion: 2.1 time: 0.159285 Oct 05 20:30:31.837011 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 563/1098] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:31 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:33.929468 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-a4d20577-31db-43d0-a301-63d5abefe5e0 req-25eb7f6a-df29-4b53-8f5a-c102b64ae646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:33.941777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a4d20577-31db-43d0-a301-63d5abefe5e0 req-25eb7f6a-df29-4b53-8f5a-c102b64ae646 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:33.942893 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a4d20577-31db-43d0-a301-63d5abefe5e0 req-25eb7f6a-df29-4b53-8f5a-c102b64ae646 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:33.943782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-a4d20577-31db-43d0-a301-63d5abefe5e0 req-25eb7f6a-df29-4b53-8f5a-c102b64ae646 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:33.957197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-a4d20577-31db-43d0-a301-63d5abefe5e0 req-25eb7f6a-df29-4b53-8f5a-c102b64ae646 service nova] Creating event network-changed:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:30:33.963831 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-a4d20577-31db-43d0-a301-63d5abefe5e0 req-25eb7f6a-df29-4b53-8f5a-c102b64ae646 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041148 Oct 05 20:30:33.968002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 536/1099] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:30:35.647151 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1641834187", "imageRef": "8855ed25-48b7-4a62-85b6-0b62ff966c9a", "flavorRef": "452"}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:35.700744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] validate_networks() for None {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:30:36.266203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:30:36.267054 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:30:36.267585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:30:36.268103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:30:36.268623 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:30:36.278950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:36.279661 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:36.280326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:36.281125 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:36.281833 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:36.282510 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:36.300775 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Getting quotas for project d48650468b294dc39afeddab84939924. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:30:36.305137 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Getting quotas for user f2265fddf2704b5991c63c0267ae1730 and project d48650468b294dc39afeddab84939924. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:30:36.316659 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:30:36.319725 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8855ed25-48b7-4a62-85b6-0b62ff966c9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:30:36.391667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9031aa9d-5d64-4668-8d4f-1cdcda936dc1 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748321 Oct 05 20:30:36.392328 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 564/1100] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:30:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 20:30:36.404525 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-cef759fa-28af-421b-ae55-489ebc1394ed tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:36.405220 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-cef759fa-28af-421b-ae55-489ebc1394ed tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:36.475228 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-cef759fa-28af-421b-ae55-489ebc1394ed tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:36.483615 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-cef759fa-28af-421b-ae55-489ebc1394ed tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1215 microversion: 2.1 time: 0.083195 Oct 05 20:30:36.484549 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 537/1101] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:36 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:37.517395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:37.518111 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:37.528978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:37.529463 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:37.529920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:37.530988 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:37.531601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:37.532179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:37.598620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:37.606445 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-01107397-b997-4473-8fa3-5abae86a67ff tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1267 microversion: 2.1 time: 0.103853 Oct 05 20:30:37.607008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 565/1102] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:37 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:38.635450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:38.636431 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:38.643798 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:38.644961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:38.645491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:38.646230 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:38.646688 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:38.647119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:38.711254 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:38.722058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c2019c87-a173-4774-b0b4-227c4e2236e9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1273 microversion: 2.1 time: 0.090378 Oct 05 20:30:38.722663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 538/1103] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:38 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:39.633339 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-cfb42292-00d2-412f-ad71-043f2eea5544 req-0e7455d5-7e48-4541-8912-71244ca04d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c78316-9656-47a1-965d-2d86e9ba8bd3", "tag": "21c00c0c-1c20-4171-aee2-4d76f2cd6df2"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:39.644528 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-cfb42292-00d2-412f-ad71-043f2eea5544 req-0e7455d5-7e48-4541-8912-71244ca04d14 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:39.646284 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-cfb42292-00d2-412f-ad71-043f2eea5544 req-0e7455d5-7e48-4541-8912-71244ca04d14 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:39.646721 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-cfb42292-00d2-412f-ad71-043f2eea5544 req-0e7455d5-7e48-4541-8912-71244ca04d14 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:39.660665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-cfb42292-00d2-412f-ad71-043f2eea5544 req-0e7455d5-7e48-4541-8912-71244ca04d14 service nova] Creating event network-changed:21c00c0c-1c20-4171-aee2-4d76f2cd6df2 for instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 on hv-cinder-80152 Oct 05 20:30:39.665714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-cfb42292-00d2-412f-ad71-043f2eea5544 req-0e7455d5-7e48-4541-8912-71244ca04d14 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036045 Oct 05 20:30:39.666311 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 566/1104] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:30:39.744135 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:39.744742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:39.751158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:39.751566 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:39.752029 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:39.752792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:39.753782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:39.754213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:39.889593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:39.897131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-23d377f9-6fe4-4f64-8742-8077034a7dfa tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1315 microversion: 2.1 time: 0.156864 Oct 05 20:30:39.897820 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 539/1105] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:39 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:40.920946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:40.921700 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:40.928590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:40.929073 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:40.929506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:40.930226 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:40.930680 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:40.931101 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:41.143230 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:41.151568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3c3c059d-ec05-4e1f-a2bb-91242c1a57b9 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1315 microversion: 2.1 time: 0.235526 Oct 05 20:30:41.152132 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 567/1106] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:40 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:42.174722 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:42.175362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:42.181583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:42.182066 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:42.182504 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:42.183199 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:42.183651 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:42.184078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:42.313540 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:42.322143 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ac5d0e6c-c9e7-438c-9fc0-0b6ab0687017 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1315 microversion: 2.1 time: 0.151299 Oct 05 20:30:42.322712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 540/1107] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:42 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:43.344547 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:43.345164 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:43.352165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:43.352651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:43.353091 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:43.353813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:43.354274 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:43.354701 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:43.485550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:43.493855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-6faf7ba9-d2f4-42ac-8655-40db6836f68c tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1315 microversion: 2.1 time: 0.153196 Oct 05 20:30:43.494427 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 568/1108] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:43 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:43.950090 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-316538f0-2552-4500-866e-24c39be91898 req-264689e3-bc30-4c4a-8a32-fe1aa495d068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c78316-9656-47a1-965d-2d86e9ba8bd3", "name": "network-vif-plugged", "status": "completed", "tag": "21c00c0c-1c20-4171-aee2-4d76f2cd6df2"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:43.961035 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-316538f0-2552-4500-866e-24c39be91898 req-264689e3-bc30-4c4a-8a32-fe1aa495d068 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:43.962163 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-316538f0-2552-4500-866e-24c39be91898 req-264689e3-bc30-4c4a-8a32-fe1aa495d068 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:43.962605 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-316538f0-2552-4500-866e-24c39be91898 req-264689e3-bc30-4c4a-8a32-fe1aa495d068 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:43.974528 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-316538f0-2552-4500-866e-24c39be91898 req-264689e3-bc30-4c4a-8a32-fe1aa495d068 service nova] Creating event network-vif-plugged:21c00c0c-1c20-4171-aee2-4d76f2cd6df2 for instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 on hv-cinder-80152 Oct 05 20:30:43.980107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-316538f0-2552-4500-866e-24c39be91898 req-264689e3-bc30-4c4a-8a32-fe1aa495d068 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033590 Oct 05 20:30:43.980722 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 541/1109] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:30:44.516580 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:44.517100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:44.519542 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:44.525804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:44.526296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:44.526727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:44.527429 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:44.527880 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:44.528306 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:44.533667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=75 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:44.659377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:44.668739 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f7fc2b0e-4896-44f8-9d00-cbddf81d7e20 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1315 microversion: 2.1 time: 0.155983 Oct 05 20:30:44.669588 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 569/1110] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:44 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:45.694530 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:45.695360 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:45.698198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=35 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:45.705778 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:45.706279 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:45.706729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:45.707979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:45.709341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:45.709341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:45.712836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=67 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:45.842544 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:45.853699 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-65e02bd7-0512-42fc-a6bd-ba2f9fcf96ca tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1465 microversion: 2.1 time: 0.164154 Oct 05 20:30:45.854387 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 542/1111] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:45 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1465 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:45.902370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:45.902859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:45.909223 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:45.909752 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:45.910197 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:45.910889 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:45.911341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:45.911764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:45.938117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:30:46.013617 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-21242ec3-abec-4d4e-88ff-9ec843b19c61 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "DELETE /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 204 len: 0 microversion: 2.1 time: 0.114674 Oct 05 20:30:46.014158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 570/1112] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:30:45 2022] DELETE /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:30:46.022353 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:46.022968 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:46.028727 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:46.029217 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:46.029697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:46.030408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:46.030846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:46.031272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:46.165768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:46.173446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ba7a72cb-7ecd-4893-9615-1746f75f488b tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1471 microversion: 2.1 time: 0.155062 Oct 05 20:30:46.174047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 543/1113] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:46 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1471 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:47.197717 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:47.198435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:47.200365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:47.201028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:47.207118 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:47.207600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:47.208037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:47.209392 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:47.209894 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:47.210467 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:47.343629 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:47.351359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-4f0684f9-6a5b-4f62-8b64-2b095d5f1be3 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1471 microversion: 2.1 time: 0.159001 Oct 05 20:30:47.351911 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 571/1114] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:47 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:48.277311 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-687323fa-ffb5-44ac-a398-b3d19b2d81c2 req-2658f5e1-b5ac-4c0b-81c3-3ce50e44d7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c78316-9656-47a1-965d-2d86e9ba8bd3", "name": "network-vif-deleted", "tag": "21c00c0c-1c20-4171-aee2-4d76f2cd6df2"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:30:48.284051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:30:48.291636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-687323fa-ffb5-44ac-a398-b3d19b2d81c2 req-2658f5e1-b5ac-4c0b-81c3-3ce50e44d7fd service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:48.292259 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-687323fa-ffb5-44ac-a398-b3d19b2d81c2 req-2658f5e1-b5ac-4c0b-81c3-3ce50e44d7fd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:48.292885 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-687323fa-ffb5-44ac-a398-b3d19b2d81c2 req-2658f5e1-b5ac-4c0b-81c3-3ce50e44d7fd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:48.305120 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-687323fa-ffb5-44ac-a398-b3d19b2d81c2 req-2658f5e1-b5ac-4c0b-81c3-3ce50e44d7fd service nova] Creating event network-vif-deleted:21c00c0c-1c20-4171-aee2-4d76f2cd6df2 for instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 on hv-cinder-80152 Oct 05 20:30:48.310824 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-687323fa-ffb5-44ac-a398-b3d19b2d81c2 req-2658f5e1-b5ac-4c0b-81c3-3ce50e44d7fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037118 Oct 05 20:30:48.311782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 544/1115] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:30:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:30:48.375677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:48.377016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:48.384379 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:48.384867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:48.385301 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:48.386027 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:48.386727 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:48.387297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:48.418497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:48.418974 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:48.419409 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:48.419841 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.objects.instance [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lazy-loading 'fault' on Instance uuid 46c78316-9656-47a1-965d-2d86e9ba8bd3 {{(pid=120351) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:30:48.462954 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2265fddf2704b5991c63c0267ae1730', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd48650468b294dc39afeddab84939924', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:30:48.470926 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2facd3d9-b229-4ddf-9c80-90b7a05dca21 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 200 len: 1305 microversion: 2.1 time: 0.099569 Oct 05 20:30:48.473643 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 572/1116] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:48 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:30:49.495866 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:30:49.496687 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] [instance: 46c78316-9656-47a1-965d-2d86e9ba8bd3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:30:49.503011 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:49.503499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:49.503935 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:49.504626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:30:49.505690 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:30:49.506122 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:30:49.519153 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] HTTP exception thrown: Instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 could not be found. Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Request method failure captured: Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 HTTP/1.1 Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPelp2MXgPVsS86dA0ELyq2NGg9QbQdobN-fUJX58zzwWBVlQjbBv0ye9hBNfIBzlgWOc3ztVAhAo_tkhY4e7dBvA_HBbUDzJ3dFr4M9tUPxefCY2QvpYQiMeZa5Y_THBjrGVFPuvT9iTxkVCyYrc7j2shhY865kLT6_n8Jf7Ay_mE6k Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: d48650468b294dc39afeddab84939924 Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-VolumesNegativeTest-772057888 Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:30:49.520768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d48650468b294dc39afeddab84939924"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_d48650468b294dc39afeddab84939924"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/d48650468b294dc39afeddab84939924"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/d48650468b294dc39afeddab84939924"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-VolumesNegativeTest-772057888 Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: d48650468b294dc39afeddab84939924 Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-VolumesNegativeTest-772057888 Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-VolumesNegativeTest-772057888-project Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: f2265fddf2704b5991c63c0267ae1730 Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-VolumesNegativeTest-772057888-project Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 could not be found. Oct 05 20:30:49.522293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '46c78316-9656-47a1-965d-2d86e9ba8bd3'} Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 could not be found. Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:30:49.523341 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 could not be found. Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 could not be found. Oct 05 20:30:49.525213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:30:49.527071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] Returning 404 to user: Instance 46c78316-9656-47a1-965d-2d86e9ba8bd3 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:30:49.527071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-66ce501e-af4c-4e46-87a1-e24a2050c9d5 tempest-VolumesNegativeTest-772057888 tempest-VolumesNegativeTest-772057888-project] 10.222.0.23 "GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3" status: 404 len: 111 microversion: 2.1 time: 0.031161 Oct 05 20:30:49.527071 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 545/1117] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:30:49 2022] GET /compute/v2.1/servers/46c78316-9656-47a1-965d-2d86e9ba8bd3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:31:04.054387 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:04.056919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:04.290432 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-464bd1c9-35b6-4836-975e-fcc08bfc910e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Action: 'create', calling method: .version_select at 0x7f3e025e8e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2076628725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoAtgsvfgl0GBdvhHKf6PBxZeeN+GPD8pZ1Zo39+CRsu2YoWhnc0Vrpmqx2Ddg31mcRD8ZYjIP2Ffg7kUkmDfFAnlwMrlAwTtvvCLiTAxrKrHt94iMVuLih+nS5I8js/A=="}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:31:04.305837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-464bd1c9-35b6-4836-975e-fcc08bfc910e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for project 3dae2633ff47484981df67d10b94de47. Resources: {'key_pairs'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:31:04.310804 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-464bd1c9-35b6-4836-975e-fcc08bfc910e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for user 7a5a70e8cad0452188dd1b750c4efa17 and project 3dae2633ff47484981df67d10b94de47. Resources: {'key_pairs'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:31:04.337912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-464bd1c9-35b6-4836-975e-fcc08bfc910e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.293005 Oct 05 20:31:04.338475 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 573/1118] 10.222.0.23 () {60 vars in 1159 bytes} [Wed Oct 5 20:31:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:31:19.586857 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1472549743", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2076628725", "security_groups": [{"name": "tempest-secgroup-smoke-1699702566"}], "block_device_mapping_v2": [{"uuid": "b27ef20a-b119-40aa-843f-07de70952d5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b5d8f50d-95d6-435a-b37d-e150d362eed6"}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:31:19.597467 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=7 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:19.598291 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=15 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:19.708285 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] validate_networks() for [('b5d8f50d-95d6-435a-b37d-e150d362eed6', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:31:20.163819 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:31:20.164266 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:31:20.164761 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:31:20.165160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:31:20.165584 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:31:20.174307 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:20.174783 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:20.175212 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:20.175926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:20.176374 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:20.176790 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:20.193774 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for project 3dae2633ff47484981df67d10b94de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:31:20.197564 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for user 7a5a70e8cad0452188dd1b750c4efa17 and project 3dae2633ff47484981df67d10b94de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:31:20.256408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:31:20.259238 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b27ef20a-b119-40aa-843f-07de70952d5e',volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:31:20.383449 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [f8be76ce-cdfd-4c78-b810-321f213b66d3] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 20:31:21.390543 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [f8be76ce-cdfd-4c78-b810-321f213b66d3] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 49838. Oct 05 20:31:21.394601 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9f792fe6-f6bf-4ded-9e92-5bc9685399b2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.811777 Oct 05 20:31:21.395271 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 546/1119] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:31:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:31:21.403820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=4 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:21.404640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:21.409123 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-205ffc39-6457-41ef-a976-ae791fb50b82 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:21.409754 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-205ffc39-6457-41ef-a976-ae791fb50b82 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:21.463912 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-205ffc39-6457-41ef-a976-ae791fb50b82 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:21.470728 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-205ffc39-6457-41ef-a976-ae791fb50b82 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1095 microversion: 2.1 time: 0.068185 Oct 05 20:31:21.471371 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 574/1120] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:21 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:22.495045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:22.495888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:22.502441 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:22.503047 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:22.503582 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:22.505007 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:22.505742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:22.506286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:22.579364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:22.587573 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7ac0c642-33fc-4947-ac6f-a641ba3351af tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1201 microversion: 2.1 time: 0.096849 Oct 05 20:31:22.588222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 547/1121] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:22 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:23.610555 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:23.611170 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:23.619349 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:23.619842 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:23.620278 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:23.621038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:23.621528 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:23.621957 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:23.822243 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:23.830179 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5077383e-53c7-466e-aeda-86617b24bb4b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.223545 Oct 05 20:31:23.830762 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 575/1122] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:23 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:24.197080 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-bc616c5f-4ed5-487c-a4f8-8a2e81f06909 req-373391e5-9cd9-4ad9-9d87-5a79abeca3f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfb4655-cc88-4186-90c6-5a2c9ef955ff", "tag": "3b5a7bf8-0abc-4420-b153-01bc13dbddef"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:31:24.207393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-bc616c5f-4ed5-487c-a4f8-8a2e81f06909 req-373391e5-9cd9-4ad9-9d87-5a79abeca3f2 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:24.208181 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-bc616c5f-4ed5-487c-a4f8-8a2e81f06909 req-373391e5-9cd9-4ad9-9d87-5a79abeca3f2 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:24.208612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-bc616c5f-4ed5-487c-a4f8-8a2e81f06909 req-373391e5-9cd9-4ad9-9d87-5a79abeca3f2 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:24.219373 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-bc616c5f-4ed5-487c-a4f8-8a2e81f06909 req-373391e5-9cd9-4ad9-9d87-5a79abeca3f2 service nova] Creating event network-changed:3b5a7bf8-0abc-4420-b153-01bc13dbddef for instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff on hv-cinder-80152 Oct 05 20:31:24.224159 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-bc616c5f-4ed5-487c-a4f8-8a2e81f06909 req-373391e5-9cd9-4ad9-9d87-5a79abeca3f2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030900 Oct 05 20:31:24.224744 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 548/1123] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:31:24.854483 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:24.855095 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:24.861800 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:24.862282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:24.862716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:24.863407 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:24.863854 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:24.864281 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:25.078703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:25.086971 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dd87c9c7-48c9-476f-bb35-511b862e2fa9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.236349 Oct 05 20:31:25.087545 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 576/1124] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:24 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:26.111277 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:26.111971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:26.118658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:26.119133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:26.119565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:26.120248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:26.120698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:26.121114 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:26.249977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:26.257548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-680d0b28-2255-4b6e-9217-5000c7ea8a23 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.150948 Oct 05 20:31:26.258117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 549/1125] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:26 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:27.280432 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:27.280960 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:27.287554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:27.288030 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:27.288459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:27.289139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:27.289622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:27.290042 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:27.416501 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:27.424086 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c20bacc7-00f3-47ed-85d0-91c152090133 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.147805 Oct 05 20:31:27.424651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 577/1126] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:27 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:31:28.447537 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:28.448180 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:28.454649 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:28.455126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:28.455558 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:28.456245 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:28.456698 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:28.457788 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:28.583414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:28.590964 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c97565d2-07e2-4506-9375-4d3acadbb373 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.147305 Oct 05 20:31:28.591530 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 550/1127] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:28 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:29.613966 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:29.614628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:29.621020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:29.621502 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:29.621964 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:29.622649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:29.623100 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:29.623524 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:29.765263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:29.773051 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-46c8f8f3-c173-47e6-9ba1-4847a4f9d722 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.163578 Oct 05 20:31:29.773640 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 578/1128] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:29 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:30.796272 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:30.796898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:30.799330 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:30.800138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=6 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:30.805945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:30.806433 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:30.806875 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:30.807572 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:30.808030 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:30.808455 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:30.943674 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:30.951367 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c07226af-177d-4243-a655-d0be057ceab2 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.159122 Oct 05 20:31:30.951948 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 551/1129] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:30 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:31.975297 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:31.975909 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:31.978280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:31:31.983619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:31.984105 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:31.984542 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:31.985232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:31.985720 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:31.986147 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:32.121601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:32.129893 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0e1f6793-caf4-44eb-847f-0bc16e5ff6c9 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.159047 Oct 05 20:31:32.130469 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 579/1130] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:31 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:33.152138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:33.152766 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:33.159198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:33.159681 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:33.160119 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:33.160816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:33.161273 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:33.161734 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:33.289589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:33.297165 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f59b3a15-7527-4632-98d1-f1014d78a0a7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.148877 Oct 05 20:31:33.297789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 552/1131] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:33 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:34.206456 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-654cc1e3-23f2-4889-ba48-47ed5b5addd3 req-3035adce-1bd4-418e-9791-92bd36bb48f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfb4655-cc88-4186-90c6-5a2c9ef955ff", "name": "network-vif-plugged", "status": "completed", "tag": "3b5a7bf8-0abc-4420-b153-01bc13dbddef"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:31:34.217352 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-654cc1e3-23f2-4889-ba48-47ed5b5addd3 req-3035adce-1bd4-418e-9791-92bd36bb48f4 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:34.217896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-654cc1e3-23f2-4889-ba48-47ed5b5addd3 req-3035adce-1bd4-418e-9791-92bd36bb48f4 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:34.218392 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-654cc1e3-23f2-4889-ba48-47ed5b5addd3 req-3035adce-1bd4-418e-9791-92bd36bb48f4 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:34.231774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-654cc1e3-23f2-4889-ba48-47ed5b5addd3 req-3035adce-1bd4-418e-9791-92bd36bb48f4 service nova] Creating event network-vif-plugged:3b5a7bf8-0abc-4420-b153-01bc13dbddef for instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff on hv-cinder-80152 Oct 05 20:31:34.236707 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-654cc1e3-23f2-4889-ba48-47ed5b5addd3 req-3035adce-1bd4-418e-9791-92bd36bb48f4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034019 Oct 05 20:31:34.237296 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 580/1132] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:31:34.321001 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:34.321666 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:34.327886 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:34.328364 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:34.328794 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:34.329478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:34.330056 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:34.330482 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:34.695495 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:34.703226 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b6b1ef15-7f7f-48ae-ad6e-7c30afb907c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1267 microversion: 2.1 time: 0.386876 Oct 05 20:31:34.703807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 553/1133] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:34 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1267 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:35.727026 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:35.727724 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:35.733932 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:35.734415 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:35.734849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:35.735534 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:35.735986 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:35.736410 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:35.871110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:35.879714 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-28a239d0-ac15-46bc-87ae-80b5255580e0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1453 microversion: 2.1 time: 0.157390 Oct 05 20:31:35.880275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 581/1134] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:35 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:35.902033 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:31:35.902645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:31:35.909045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:35.909553 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:35.910115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:35.911155 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:35.911619 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:35.912044 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:36.039658 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:31:36.047718 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6b037dd4-ad15-48d8-a756-5d84afd9b30f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1453 microversion: 2.1 time: 0.149460 Oct 05 20:31:36.048291 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 554/1135] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:31:35 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:31:37.687251 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-e481e10c-24de-428f-b3ea-b37bf83c5134 req-a81d2d95-c622-47ec-b885-19a621f17b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cfb4655-cc88-4186-90c6-5a2c9ef955ff", "tag": "3b5a7bf8-0abc-4420-b153-01bc13dbddef"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:31:37.698633 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-e481e10c-24de-428f-b3ea-b37bf83c5134 req-a81d2d95-c622-47ec-b885-19a621f17b6d service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:31:37.699108 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-e481e10c-24de-428f-b3ea-b37bf83c5134 req-a81d2d95-c622-47ec-b885-19a621f17b6d service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:31:37.699535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-e481e10c-24de-428f-b3ea-b37bf83c5134 req-a81d2d95-c622-47ec-b885-19a621f17b6d service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:31:37.710240 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-e481e10c-24de-428f-b3ea-b37bf83c5134 req-a81d2d95-c622-47ec-b885-19a621f17b6d service nova] Creating event network-changed:3b5a7bf8-0abc-4420-b153-01bc13dbddef for instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff on hv-cinder-80152 Oct 05 20:31:37.715299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-e481e10c-24de-428f-b3ea-b37bf83c5134 req-a81d2d95-c622-47ec-b885-19a621f17b6d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034223 Oct 05 20:31:37.715985 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 582/1136] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:32:41.698597 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:32:41.699351 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=46 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:32:41.700995 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 20:32:41.701186 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Wed Oct 5 20:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04/action (ip 10.222.0.23) !!! Oct 05 20:32:41.706533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:32:41.707068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:41.715016 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:41.715498 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:41.715929 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:41.716621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:41.717075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:41.717501 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:41.741641 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.objects.instance [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lazy-loading 'flavor' on Instance uuid ea21042e-8990-4497-bce2-b8cb17ea7b04 {{(pid=120350) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 20:32:41.813404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-31a0edf8-e175-406a-bb4b-6fac740e92aa tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "POST /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04/action" status: 202 len: 0 microversion: 2.1 time: 0.116534 Oct 05 20:32:41.814046 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 555/1137] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:32:41 2022] POST /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:32:41.821611 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=20 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:32:41.822386 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=40 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:32:41.828410 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:41.829121 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:41.836673 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:41.837159 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:41.837622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:41.838326 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:41.838784 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:41.839215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:42.023647 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:42.031308 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5664ac10-5669-41d0-8607-32c6558e6d2f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.211846 Oct 05 20:32:42.031879 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 583/1138] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:41 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:43.056232 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:43.056927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:43.063018 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:43.063491 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:43.063922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:43.064604 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:43.065052 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:43.065999 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:43.245141 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:43.253396 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-7bf8c3f7-ff36-4816-a55e-980e31f40b91 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.201383 Oct 05 20:32:43.253992 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 556/1139] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:43 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:44.276722 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:44.277280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:44.283753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:44.284232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:44.284665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:44.285961 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:44.286411 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:44.286832 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:44.413192 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:44.420853 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8818c531-d5cd-4fef-8677-6dd37a7327bc tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.148107 Oct 05 20:32:44.421420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 584/1140] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:44 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:45.444926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:45.445583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:45.451860 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:45.452339 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:45.452768 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:45.453452 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:45.453926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:45.454344 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:45.581089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:45.588702 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ad16e41b-fb6f-4957-890b-032412b4362a tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.147983 Oct 05 20:32:45.589263 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 557/1141] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:45 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:46.612175 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:46.612855 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:46.619220 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:46.619698 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:46.620128 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:46.620806 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:46.621254 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:46.621703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:46.750904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:46.758601 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e4910353-0043-4316-b7be-a541973a3390 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.150349 Oct 05 20:32:46.759157 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 585/1142] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:46 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:47.782548 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:47.783161 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:47.789466 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:47.789974 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:47.790407 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:47.791089 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:47.791538 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:47.791957 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:47.923318 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:47.931026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3362fe54-4f93-4858-9773-ae0c2bb3f434 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.152425 Oct 05 20:32:47.931592 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 558/1143] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:47 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:48.955550 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:48.956165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:48.962568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:48.963049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:48.963490 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:48.964175 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:48.964627 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:48.965045 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:49.095169 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:49.103358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-fda5b254-83cd-4a17-922e-57dbf1243f58 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.152194 Oct 05 20:32:49.103925 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 586/1144] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:48 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:50.127384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:50.127936 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:50.134807 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:50.135305 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:50.135735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:50.136419 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:50.136863 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:50.137280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:50.263645 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:50.271222 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3179d3b8-0bc5-47e5-a3fb-1a0698b64407 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.147793 Oct 05 20:32:50.271788 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 559/1145] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:50 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:32:51.295354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:51.295873 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:51.302341 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:51.302820 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:51.303256 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:51.303942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:51.304396 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:51.304817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:51.434646 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:51.443238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dcd4e938-5938-4dbf-9031-4d02378b8b6e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.151588 Oct 05 20:32:51.443792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 587/1146] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:51 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:52.466533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:52.467172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:52.474522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:52.475006 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:52.475437 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:52.476133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:52.476579 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:52.476996 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:52.613880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:52.621559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-90084168-6c2d-4311-b328-dc9d9681beea tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.158853 Oct 05 20:32:52.622142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 560/1147] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:52 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:53.647572 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:53.648175 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:53.654677 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:53.655156 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:53.655593 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:53.656275 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:53.656725 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:53.657145 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:53.790663 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:53.798378 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-8e4cf3c3-e705-43f1-949c-8ac6e1a89bb3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.154611 Oct 05 20:32:53.798942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 588/1148] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:53 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:54.822715 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:54.823308 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:54.829600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:54.830078 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:54.830565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:54.831197 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:54.831644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:54.832062 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:54.964000 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:54.971855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-9f48bf03-a34a-4c8b-aaff-621663d35b2b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1568 microversion: 2.1 time: 0.152933 Oct 05 20:32:54.972424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 561/1149] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:54 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:54.994166 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:32:54.994766 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:55.001110 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:55.001649 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:55.002090 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:55.002781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:55.003233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:55.003660 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:55.032539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120351) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 20:32:55.098911 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e873de37-5e0c-407d-b422-812c0459a4cb tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "POST /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04/action" status: 202 len: 0 microversion: 2.1 time: 0.108564 Oct 05 20:32:55.108121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:55.109060 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:55.109740 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 589/1150] 10.222.0.23 () {60 vars in 1278 bytes} [Wed Oct 5 20:32:54 2022] POST /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:32:55.116195 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:55.116684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:55.117110 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:55.117868 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:55.118394 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:55.118960 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:55.255630 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:55.263627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8772cd9d-1039-4e29-b0b9-990311be9d9d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1516 microversion: 2.1 time: 0.159642 Oct 05 20:32:55.264191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 562/1151] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:55 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:32:56.286950 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:56.287497 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:56.293338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:56.293859 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:56.294298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:56.294998 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:56.295449 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:56.295877 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:56.432539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:56.440264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-43f5b0b9-7fb7-496d-a5e2-fbb9f5383ae3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1518 microversion: 2.1 time: 0.157554 Oct 05 20:32:56.440825 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 590/1152] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:56 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:56.627909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-c59d7e84-a729-46aa-b282-723abcf60816 req-454abfa5-0da9-43cd-882a-b69c3c78c3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "name": "network-vif-unplugged", "status": "completed", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:32:56.643618 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c59d7e84-a729-46aa-b282-723abcf60816 req-454abfa5-0da9-43cd-882a-b69c3c78c3d3 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:56.644203 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c59d7e84-a729-46aa-b282-723abcf60816 req-454abfa5-0da9-43cd-882a-b69c3c78c3d3 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:56.644613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-c59d7e84-a729-46aa-b282-723abcf60816 req-454abfa5-0da9-43cd-882a-b69c3c78c3d3 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:56.656921 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-c59d7e84-a729-46aa-b282-723abcf60816 req-454abfa5-0da9-43cd-882a-b69c3c78c3d3 service nova] Creating event network-vif-unplugged:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:32:56.661926 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-c59d7e84-a729-46aa-b282-723abcf60816 req-454abfa5-0da9-43cd-882a-b69c3c78c3d3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099732 Oct 05 20:32:56.662659 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 563/1153] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:32:57.464308 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:57.464920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:57.471751 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:57.472238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:57.472671 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:57.473417 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:57.473896 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:57.474345 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:57.653920 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:57.661561 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-ebfdf049-90fd-45ee-8b2b-3e00ee558bf8 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.201206 Oct 05 20:32:57.662139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 591/1154] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:57 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:58.686913 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:58.687653 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:58.694069 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:58.694554 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:58.694984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:58.695672 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:58.696121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:58.696541 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:58.829198 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:32:58.836830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e163d5fe-62a7-4809-a669-ba4991063b1d tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.155066 Oct 05 20:32:58.837390 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 564/1155] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:58 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:32:59.860161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:32:59.860939 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:32:59.867703 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:59.868195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:59.868632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:32:59.869338 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:32:59.869837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:32:59.870262 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:00.103682 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:00.111519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-dcf4966b-12e6-4c4d-8b29-280b123eb7d3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.255229 Oct 05 20:33:00.112092 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 592/1156] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:32:59 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:01.136302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:01.136932 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:01.143413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:01.143891 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:01.144315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:01.144997 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:01.145443 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:01.145888 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:01.272362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:01.280072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-14b825e6-f78e-4e95-b1fe-ce841b5a00af tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.147629 Oct 05 20:33:01.280637 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 565/1157] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:01 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:02.304185 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:02.304748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:02.311201 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:02.311704 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:02.312135 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:02.312815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:02.313264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:02.313713 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:02.447586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:02.455232 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-07384c2a-5d55-4698-9df4-1ce6b10df029 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.155031 Oct 05 20:33:02.455802 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 593/1158] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:02 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:03.478970 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:03.479578 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:03.486115 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:03.486590 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:03.487021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:03.487703 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:03.488149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:03.488567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:03.616914 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:03.624631 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8ed208a5-e31a-4c14-9316-cc4d9720d92c tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.149499 Oct 05 20:33:03.625186 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 566/1159] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:03 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:04.648233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:04.649908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:04.658554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:04.659044 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:04.659479 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:04.660174 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:04.660625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:04.661574 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:04.792001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:04.799719 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-47cc7431-28ba-4a28-9aab-3d5a137abe7e tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.155424 Oct 05 20:33:04.800283 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 594/1160] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:04 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:05.823900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:05.824486 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:05.831126 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:05.831614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:05.832051 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:05.832745 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:05.833202 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:05.833662 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:05.968230 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:05.976560 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-a0e059c9-d305-4570-8d34-d59dd527c99b tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.156638 Oct 05 20:33:05.977133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 567/1161] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:05 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:06.675523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-122ed8ec-df38-4f4a-81bd-b1f19e9ab361 req-bcb76461-10a7-4b63-a536-9841711f525b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "name": "network-vif-plugged", "status": "completed", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:33:06.685477 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-122ed8ec-df38-4f4a-81bd-b1f19e9ab361 req-bcb76461-10a7-4b63-a536-9841711f525b service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:06.685989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-122ed8ec-df38-4f4a-81bd-b1f19e9ab361 req-bcb76461-10a7-4b63-a536-9841711f525b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:06.686432 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-122ed8ec-df38-4f4a-81bd-b1f19e9ab361 req-bcb76461-10a7-4b63-a536-9841711f525b service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:06.698289 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-122ed8ec-df38-4f4a-81bd-b1f19e9ab361 req-bcb76461-10a7-4b63-a536-9841711f525b service nova] Creating event network-vif-plugged:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:33:06.703433 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-122ed8ec-df38-4f4a-81bd-b1f19e9ab361 req-bcb76461-10a7-4b63-a536-9841711f525b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Oct 05 20:33:06.704034 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 595/1162] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:33:07.000967 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:07.001705 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:07.008613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:07.009186 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:07.009729 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:07.010626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:07.010952 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:07.011379 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:07.138608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:07.146323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-2535a250-2c66-4595-a52b-e4f515f94cec tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1574 microversion: 2.1 time: 0.149395 Oct 05 20:33:07.146887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 568/1163] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:06 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:08.170834 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:08.171459 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:08.177665 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:08.178149 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:08.178590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:08.179278 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:08.179737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:08.180162 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:08.313303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:08.321813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2a6259ea-d711-45a8-9c59-1fa990a86213 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1561 microversion: 2.1 time: 0.155826 Oct 05 20:33:08.322384 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 596/1164] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:08 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:33.331593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:33.332166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:33.334421 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=28 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:33.335116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:33.341414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:33.341988 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:33.342427 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:33.343128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:33.343586 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:33.344017 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:33.369603 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:33:33.441607 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ff163cc4-5ee4-4e98-90e2-1175a5ae1dd0 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 204 len: 0 microversion: 2.1 time: 0.113506 Oct 05 20:33:33.442302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 569/1165] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:33:33 2022] DELETE /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:33:33.451592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:33.452205 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:33.454334 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:33.455115 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:33.461112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:33.461619 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:33.462057 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:33.462744 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:33.463202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:33.463625 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:33.591375 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:33.599017 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-1bc7bcc4-414d-4ab8-bd29-95cf66b8f36a tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1578 microversion: 2.1 time: 0.151493 Oct 05 20:33:33.599585 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 597/1166] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:33 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:33:34.622533 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:34.623228 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:34.629528 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:34.630010 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:34.630443 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:34.631627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:34.632072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:34.632488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:34.765063 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:34.773535 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8aea70e0-08c9-4ae5-9d8f-41650baacc86 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1578 microversion: 2.1 time: 0.155203 Oct 05 20:33:34.774106 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 570/1167] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:34 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:35.798626 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:35.799753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:35.807737 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:35.808304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:35.808813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:35.809730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:35.810259 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:35.810759 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:35.900801 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:35.908656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-2721f606-3835-41fc-8521-980d8d24e39d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 200 len: 1510 microversion: 2.1 time: 0.114642 Oct 05 20:33:35.909231 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 598/1168] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:35 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 1510 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:36.152076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-d2960ad1-89d7-4cd2-8f52-1d3a350978e4 req-1fd16e2d-d55f-49c3-ba81-3843a6e01e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cfb4655-cc88-4186-90c6-5a2c9ef955ff", "name": "network-vif-deleted", "tag": "3b5a7bf8-0abc-4420-b153-01bc13dbddef"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:33:36.165004 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-d2960ad1-89d7-4cd2-8f52-1d3a350978e4 req-1fd16e2d-d55f-49c3-ba81-3843a6e01e54 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:36.165488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-d2960ad1-89d7-4cd2-8f52-1d3a350978e4 req-1fd16e2d-d55f-49c3-ba81-3843a6e01e54 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:36.165951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-d2960ad1-89d7-4cd2-8f52-1d3a350978e4 req-1fd16e2d-d55f-49c3-ba81-3843a6e01e54 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:36.184229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-d2960ad1-89d7-4cd2-8f52-1d3a350978e4 req-1fd16e2d-d55f-49c3-ba81-3843a6e01e54 service nova] Creating event network-vif-deleted:3b5a7bf8-0abc-4420-b153-01bc13dbddef for instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff on hv-cinder-80152 Oct 05 20:33:36.190068 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-d2960ad1-89d7-4cd2-8f52-1d3a350978e4 req-1fd16e2d-d55f-49c3-ba81-3843a6e01e54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102698 Oct 05 20:33:36.190979 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 571/1169] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:33:36.932843 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:36.933685 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:36.940521 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:36.941029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:36.941468 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:36.942377 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:36.942753 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:36.943171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:36.960228 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] HTTP exception thrown: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Request method failure captured: Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff HTTP/1.1 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPemChnLZajzx9PjlBgyJBW0Zcdw9Sstp5Arhc7fMab9OZCUwHsG2Yq2dZyRaLc24_Pt-91L4bf7cn75EOA7cyRcqfMeJXQZAn1GXFDUYHD-lV1tXNZJwfibRIlEFLWyXLFGVChgBHCTZY36VbZhDsdIg0FsKsCTEj1RHTbL2ja1B6A0 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:33:36.962020 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3dae2633ff47484981df67d10b94de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3dae2633ff47484981df67d10b94de47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 7a5a70e8cad0452188dd1b750c4efa17 Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:33:36.963858 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '4cfb4655-cc88-4186-90c6-5a2c9ef955ff'} Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:33:36.965010 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:33:36.966683 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:33:36.968215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Returning 404 to user: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:33:36.968215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f54ce5b2-249b-4a6f-8758-3054c19c31c4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 404 len: 111 microversion: 2.1 time: 0.034872 Oct 05 20:33:36.968215 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 599/1170] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:36 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:33:37.013013 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1675818422", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2076628725", "security_groups": [{"name": "tempest-secgroup-smoke-1699702566"}], "block_device_mapping_v2": [{"uuid": "b27ef20a-b119-40aa-843f-07de70952d5e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b5d8f50d-95d6-435a-b37d-e150d362eed6"}]}} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:33:37.132224 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.network.neutron [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] validate_networks() for [('b5d8f50d-95d6-435a-b37d-e150d362eed6', None, None, None, None, None)] {{(pid=120350) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:33:37.498257 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Flavor limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:33:37.498846 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Image limits 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:33:37.499138 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Flavor pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:33:37.499545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Image pref 0:0:0 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:33:37.499953 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.virt.hardware [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120350) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:33:37.509503 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:37.510009 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:37.510439 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:37.511158 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:37.511612 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:37.512030 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:37.528703 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for project 3dae2633ff47484981df67d10b94de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:33:37.532559 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.quota [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for user 7a5a70e8cad0452188dd1b750c4efa17 and project 3dae2633ff47484981df67d10b94de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120350) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:33:37.588248 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Going to run 1 instances... {{(pid=120350) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:33:37.590499 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b27ef20a-b119-40aa-843f-07de70952d5e',volume_size=None,volume_type=None)] {{(pid=120350) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:33:37.716911 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8f23330d-d52f-412f-be3a-86e89ee3ed00 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.708051 Oct 05 20:33:37.717574 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 572/1171] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:33:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:33:37.728989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-31f44032-096f-4752-98c4-55c619365239 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:37.729614 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-31f44032-096f-4752-98c4-55c619365239 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:37.786818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-31f44032-096f-4752-98c4-55c619365239 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:37.794094 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-31f44032-096f-4752-98c4-55c619365239 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1095 microversion: 2.1 time: 0.069393 Oct 05 20:33:37.795271 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 600/1172] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:37 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:38.816996 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:38.817792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:38.825213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:38.825817 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:38.826332 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:38.827121 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:38.827676 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:38.828335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:38.894229 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:38.902293 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ede1bee3-e3fe-4fb1-96cf-71a83823fe2b tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1201 microversion: 2.1 time: 0.089662 Oct 05 20:33:38.902874 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 573/1173] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:38 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:39.925559 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:39.926153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:39.933462 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:39.933978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:39.934412 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:39.935139 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:39.935764 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:39.936195 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:40.125317 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:40.133636 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-7e81ab40-e1cf-4521-bd6e-69c7fbd26597 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.211956 Oct 05 20:33:40.134203 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 601/1174] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:39 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:40.273147 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-5b32b468-c717-4e96-8828-edb615cd1b8c req-a25ed9ce-5071-4f27-bd01-7fc3617d99a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334afcdf-49a7-4407-a4e5-6e08732c0f09", "tag": "5c8442c9-a216-465d-989a-71ac69a03040"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:33:40.283384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-5b32b468-c717-4e96-8828-edb615cd1b8c req-a25ed9ce-5071-4f27-bd01-7fc3617d99a7 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:40.284072 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-5b32b468-c717-4e96-8828-edb615cd1b8c req-a25ed9ce-5071-4f27-bd01-7fc3617d99a7 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:40.284500 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-5b32b468-c717-4e96-8828-edb615cd1b8c req-a25ed9ce-5071-4f27-bd01-7fc3617d99a7 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:40.296117 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-5b32b468-c717-4e96-8828-edb615cd1b8c req-a25ed9ce-5071-4f27-bd01-7fc3617d99a7 service nova] Creating event network-changed:5c8442c9-a216-465d-989a-71ac69a03040 for instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 on hv-cinder-80152 Oct 05 20:33:40.301145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-5b32b468-c717-4e96-8828-edb615cd1b8c req-a25ed9ce-5071-4f27-bd01-7fc3617d99a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 Oct 05 20:33:40.301782 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 574/1175] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:33:41.156272 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:41.156886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:41.163770 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:41.164249 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:41.164681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:41.165373 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:41.165850 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:41.166272 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:41.632632 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:41.640273 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e9f64d35-5ba7-4bac-aa54-9919fab6719c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.487849 Oct 05 20:33:41.640837 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 602/1176] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:41 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 20:33:42.664918 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:42.665650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:42.671773 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:42.672281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:42.672713 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:42.673397 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:42.673879 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:42.674299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:42.807844 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:42.815471 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-3321f7ef-27c4-4c38-adfe-e0766a0c56c5 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.155785 Oct 05 20:33:42.816045 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 575/1177] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:42 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:43.837978 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:43.838586 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:43.845038 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:43.845536 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:43.845977 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:43.846667 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:43.847120 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:43.847542 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:43.976370 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:43.983941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-d0e462f4-39eb-40e3-a28f-fd1c358246a3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.149929 Oct 05 20:33:43.984505 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 603/1178] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:43 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:45.007369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:45.007984 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:45.014393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:45.014900 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:45.015334 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:45.016024 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:45.016476 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:45.016977 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:45.143770 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:45.152490 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-b53f7d7b-1e5a-4240-b113-b23184378d6e tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.149458 Oct 05 20:33:45.153054 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 576/1179] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:45 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:46.174287 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:46.174895 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:46.181416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:46.181924 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:46.182354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:46.183036 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:46.183482 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:46.183899 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:46.314026 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:46.321877 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e18049bd-4c4b-4d7d-a930-990f4dd01c96 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.151420 Oct 05 20:33:46.322435 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 604/1180] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:46 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:47.344227 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:47.344843 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:47.351483 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:47.351972 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:47.352414 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:47.353109 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:47.353600 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:47.354034 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:47.482808 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:47.490971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8334c506-c3e9-40a7-a4fc-b7a40afcf09c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.150625 Oct 05 20:33:47.491529 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 577/1181] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:47 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:48.514789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:48.515393 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:48.517748 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:48.523147 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:48.523624 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:48.524056 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:48.524734 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:48.525180 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:48.525628 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:48.651634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:48.659331 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e3bf21cd-9eaa-4c87-b883-2f7d940c384c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.148462 Oct 05 20:33:48.659863 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 605/1182] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:48 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:49.682889 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:49.683509 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:49.685436 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:49.686244 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=6 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:33:49.692340 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:49.692825 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:49.693294 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:49.694286 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:49.694742 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:49.695171 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:49.826210 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:49.834399 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-dbe7ccc2-2150-4457-913d-a512bfcc9b6d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.154892 Oct 05 20:33:49.834971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 578/1183] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:49 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:50.856385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:50.856995 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:50.863556 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:50.864037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:50.864480 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:50.865789 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:50.866237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:50.866651 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:50.957282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-4b88ccb3-d3e3-45e9-bf67-80c5a5d999c3 req-3ee99f23-2c30-4897-915e-752c17bdd0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334afcdf-49a7-4407-a4e5-6e08732c0f09", "name": "network-vif-plugged", "status": "completed", "tag": "5c8442c9-a216-465d-989a-71ac69a03040"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:33:50.968927 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4b88ccb3-d3e3-45e9-bf67-80c5a5d999c3 req-3ee99f23-2c30-4897-915e-752c17bdd0bd service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:50.969432 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4b88ccb3-d3e3-45e9-bf67-80c5a5d999c3 req-3ee99f23-2c30-4897-915e-752c17bdd0bd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:50.970466 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-4b88ccb3-d3e3-45e9-bf67-80c5a5d999c3 req-3ee99f23-2c30-4897-915e-752c17bdd0bd service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:50.985969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-4b88ccb3-d3e3-45e9-bf67-80c5a5d999c3 req-3ee99f23-2c30-4897-915e-752c17bdd0bd service nova] Creating event network-vif-plugged:5c8442c9-a216-465d-989a-71ac69a03040 for instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 on hv-cinder-80152 Oct 05 20:33:50.991830 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-4b88ccb3-d3e3-45e9-bf67-80c5a5d999c3 req-3ee99f23-2c30-4897-915e-752c17bdd0bd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038318 Oct 05 20:33:50.992735 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 579/1184] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:33:51.018520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:51.026532 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-61927178-0b5b-4391-a1ea-746706604411 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.174109 Oct 05 20:33:51.027193 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 606/1185] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:50 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:52.050752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:52.051445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:52.058665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:52.059145 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:52.059577 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:52.060261 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:52.060711 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:52.061131 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:52.189663 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:52.198282 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-5a723634-d8fc-4946-9424-7642d720f8c3 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1267 microversion: 2.1 time: 0.151697 Oct 05 20:33:52.198855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 580/1186] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:52 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:53.220815 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:53.221399 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:53.228076 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:53.228552 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:53.228983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:53.229706 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:53.230153 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:53.230571 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:53.360788 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:53.368519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-469a0fca-b5e9-4260-84c3-bd8890ef998f tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1453 microversion: 2.1 time: 0.151635 Oct 05 20:33:53.369091 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 607/1187] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:53 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:53.390996 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:33:53.391608 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:33:53.403852 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:53.404335 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:53.404770 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:53.405496 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:53.405971 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:53.406393 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:53.556459 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:33:53.564223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bf37e27d-56a7-4cbf-8a6b-46330963709c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1453 microversion: 2.1 time: 0.177043 Oct 05 20:33:53.564792 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 581/1188] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:33:53 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:33:55.405946 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-799a8b0d-e610-4a25-9458-546441e24922 req-fac7cea9-b3ac-4044-875a-bf39a3c861a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334afcdf-49a7-4407-a4e5-6e08732c0f09", "tag": "5c8442c9-a216-465d-989a-71ac69a03040"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:33:55.416021 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-799a8b0d-e610-4a25-9458-546441e24922 req-fac7cea9-b3ac-4044-875a-bf39a3c861a6 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:33:55.416600 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-799a8b0d-e610-4a25-9458-546441e24922 req-fac7cea9-b3ac-4044-875a-bf39a3c861a6 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:33:55.417104 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-799a8b0d-e610-4a25-9458-546441e24922 req-fac7cea9-b3ac-4044-875a-bf39a3c861a6 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:33:55.428620 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-799a8b0d-e610-4a25-9458-546441e24922 req-fac7cea9-b3ac-4044-875a-bf39a3c861a6 service nova] Creating event network-changed:5c8442c9-a216-465d-989a-71ac69a03040 for instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 on hv-cinder-80152 Oct 05 20:33:55.433984 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-799a8b0d-e610-4a25-9458-546441e24922 req-fac7cea9-b3ac-4044-875a-bf39a3c861a6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084748 Oct 05 20:33:55.434594 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 608/1189] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:34:22.363724 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:34:22.364263 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=26 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:34:22.364632 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:34:22.364730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=58 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:34:22.366158 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 20:34:22.366340 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Wed Oct 5 20:34:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 05 20:34:22.371536 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:34:22.372205 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:34:22.372337 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-9e5f8e42-ac07-4399-a0b2-297e77ad5e41 req-29b4eacd-221e-4be9-ae28-28ee753db304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:34:22.374635 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:22.375149 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:22.375565 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:22.376269 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:22.376752 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:22.377175 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:22.386018 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-9e5f8e42-ac07-4399-a0b2-297e77ad5e41 req-29b4eacd-221e-4be9-ae28-28ee753db304 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:22.386844 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-9e5f8e42-ac07-4399-a0b2-297e77ad5e41 req-29b4eacd-221e-4be9-ae28-28ee753db304 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:22.387241 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-9e5f8e42-ac07-4399-a0b2-297e77ad5e41 req-29b4eacd-221e-4be9-ae28-28ee753db304 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:22.402884 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-9e5f8e42-ac07-4399-a0b2-297e77ad5e41 req-29b4eacd-221e-4be9-ae28-28ee753db304 service nova] Creating event network-changed:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:34:22.408339 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Going to try to terminate instance {{(pid=120350) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:34:22.413774 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-9e5f8e42-ac07-4399-a0b2-297e77ad5e41 req-29b4eacd-221e-4be9-ae28-28ee753db304 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051278 Oct 05 20:34:22.414849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 609/1190] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:34:22.498880 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-02ef20cf-9109-4400-8271-fb4ddd027757 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "DELETE /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 204 len: 0 microversion: 2.1 time: 0.136515 Oct 05 20:34:22.499454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 582/1191] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:34:22 2022] DELETE /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:34:22.509908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:34:22.511142 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:34:22.517161 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:22.517664 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:22.518131 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:22.518818 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:22.519264 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:22.519681 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:22.651414 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:34:22.659224 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-3a58ad61-7f4b-4a34-b0e8-3f48a85071ae tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.155202 Oct 05 20:34:22.659790 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 610/1192] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:34:22 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:34:23.684200 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:34:23.684907 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:34:23.691408 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:23.691898 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:23.692343 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:23.693041 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:23.694424 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:23.694852 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:23.828712 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:34:23.836589 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-c212c7e2-635b-4957-ba2b-28fc1b390b11 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1567 microversion: 2.1 time: 0.156666 Oct 05 20:34:23.837160 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 583/1193] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:34:23 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:34:24.810886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-75c7acaf-010c-4739-bdda-e70e6d7a123c req-647fa13d-50ea-4450-920f-3e06234698c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea21042e-8990-4497-bce2-b8cb17ea7b04", "name": "network-vif-deleted", "tag": "4efa2b61-48b1-4dd0-940d-422f27db9a75"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:34:24.821634 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-75c7acaf-010c-4739-bdda-e70e6d7a123c req-647fa13d-50ea-4450-920f-3e06234698c6 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:24.822122 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-75c7acaf-010c-4739-bdda-e70e6d7a123c req-647fa13d-50ea-4450-920f-3e06234698c6 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:24.822544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-75c7acaf-010c-4739-bdda-e70e6d7a123c req-647fa13d-50ea-4450-920f-3e06234698c6 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:24.834706 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-75c7acaf-010c-4739-bdda-e70e6d7a123c req-647fa13d-50ea-4450-920f-3e06234698c6 service nova] Creating event network-vif-deleted:4efa2b61-48b1-4dd0-940d-422f27db9a75 for instance ea21042e-8990-4497-bce2-b8cb17ea7b04 on hv-cinder-80152 Oct 05 20:34:24.839798 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-75c7acaf-010c-4739-bdda-e70e6d7a123c req-647fa13d-50ea-4450-920f-3e06234698c6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032722 Oct 05 20:34:24.840395 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 611/1194] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:34:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:34:24.859955 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:34:24.860607 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:34:24.867270 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:24.868026 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:24.868697 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:24.869413 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:24.869905 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:24.870336 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:24.932450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7b64272dd774de5a7cd22776df18eca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3277eaeb27724447a3864927021c2b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:34:24.940178 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-8643e8b6-11a8-46e1-821d-50fe8a6be676 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 200 len: 1218 microversion: 2.1 time: 0.084057 Oct 05 20:34:24.940751 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 584/1195] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:34:24 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:34:25.965381 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:34:25.966120 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] [instance: ea21042e-8990-4497-bce2-b8cb17ea7b04] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:34:25.972291 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:25.972768 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:25.973227 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:25.973942 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:34:25.974400 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:34:25.975360 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:34:25.988276 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] HTTP exception thrown: Instance ea21042e-8990-4497-bce2-b8cb17ea7b04 could not be found. Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Request method failure captured: Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 HTTP/1.1 Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPek7eGpTQPRwlsVhfP0KmwRQPNxoIV54O28wS1iYMDqP-GyEaePLAqcK6SvibfECV99cLICQI5CslvrZ-Pp8Mlkkva0BHUvwfEhjD84HOWz_z_TAfYPrXWX0PmSw2jDiIUbAZhLn3T2-O04jzgxZ2bbwlTbEWM87jy5fdGv3MQ53TOs Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 3277eaeb27724447a3864927021c2b79 Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-TestShelveInstance-538126096 Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:34:25.989897 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3277eaeb27724447a3864927021c2b79"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3277eaeb27724447a3864927021c2b79"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3277eaeb27724447a3864927021c2b79"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3277eaeb27724447a3864927021c2b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-TestShelveInstance-538126096 Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 3277eaeb27724447a3864927021c2b79 Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-TestShelveInstance-538126096 Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-TestShelveInstance-538126096-project Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: b7b64272dd774de5a7cd22776df18eca Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-TestShelveInstance-538126096-project Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance ea21042e-8990-4497-bce2-b8cb17ea7b04 could not be found. Oct 05 20:34:25.994448 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': 'ea21042e-8990-4497-bce2-b8cb17ea7b04'} Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea21042e-8990-4497-bce2-b8cb17ea7b04 could not be found. Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:34:25.995781 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea21042e-8990-4497-bce2-b8cb17ea7b04 could not be found. Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea21042e-8990-4497-bce2-b8cb17ea7b04 could not be found. Oct 05 20:34:25.998079 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:34:25.999622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Returning 404 to user: Instance ea21042e-8990-4497-bce2-b8cb17ea7b04 could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:34:25.999622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b55da056-6d30-4e31-a8ba-032db59241a3 tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04" status: 404 len: 111 microversion: 2.1 time: 0.030696 Oct 05 20:34:25.999622 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 612/1196] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:34:25 2022] GET /compute/v2.1/servers/ea21042e-8990-4497-bce2-b8cb17ea7b04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:34:26.152454 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-febf388d-756c-4add-80f8-bd5194784a8f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] Calling method '.version_select at 0x7f3e0255a790>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:34:26.174431 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-febf388d-756c-4add-80f8-bd5194784a8f tempest-TestShelveInstance-538126096 tempest-TestShelveInstance-538126096-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-678612123" status: 202 len: 0 microversion: 2.1 time: 0.028052 Oct 05 20:34:26.175021 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 585/1197] 10.222.0.23 () {58 vars in 1251 bytes} [Wed Oct 5 20:34:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-678612123 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 20:35:22.537299 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-625368760", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2076628725", "security_groups": [{"name": "tempest-secgroup-smoke-1699702566"}], "block_device_mapping_v2": [{"uuid": "441b0c4e-7d84-4a1d-a85a-270826ce45dc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b5d8f50d-95d6-435a-b37d-e150d362eed6"}]}} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:35:22.547856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=8 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:22.548498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=12 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:22.656155 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.network.neutron [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] validate_networks() for [('b5d8f50d-95d6-435a-b37d-e150d362eed6', None, None, None, None, None)] {{(pid=120351) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 20:35:23.126465 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Flavor limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 20:35:23.126836 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Image limits 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 20:35:23.127343 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Flavor pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 20:35:23.127757 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Image pref 0:0:0 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 20:35:23.128364 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.virt.hardware [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120351) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 20:35:23.137416 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:23.137930 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:23.138372 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:23.139101 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:23.139559 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:23.139983 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:23.156519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for project 3dae2633ff47484981df67d10b94de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 20:35:23.160514 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.quota [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Getting quotas for user 7a5a70e8cad0452188dd1b750c4efa17 and project 3dae2633ff47484981df67d10b94de47. Resources: {'ram', 'cores', 'instances'} {{(pid=120351) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 20:35:23.217127 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Going to run 1 instances... {{(pid=120351) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 20:35:23.219298 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='441b0c4e-7d84-4a1d-a85a-270826ce45dc',volume_size=None,volume_type=None)] {{(pid=120351) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 20:35:23.343101 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [47a85ab7-6033-4180-b13a-88dee2f135c4] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 20:35:24.352037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO oslo.messaging._drivers.impl_rabbit [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [47a85ab7-6033-4180-b13a-88dee2f135c4] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 50206. Oct 05 20:35:24.356117 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-92075cd8-c53b-4f2c-8782-2f53b2427d7c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.822882 Oct 05 20:35:24.356788 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 613/1198] 10.222.0.23 () {60 vars in 1147 bytes} [Wed Oct 5 20:35:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 20:35:24.365738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:24.366487 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:24.371621 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-23277e01-4a99-41e7-91fd-307e71121403 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:24.372236 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-23277e01-4a99-41e7-91fd-307e71121403 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:24.431219 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-23277e01-4a99-41e7-91fd-307e71121403 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:24.438909 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-23277e01-4a99-41e7-91fd-307e71121403 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1094 microversion: 2.1 time: 0.074884 Oct 05 20:35:24.439478 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 586/1199] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:24 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:25.464523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:25.465282 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:25.472356 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:25.472862 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:25.473322 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:25.474046 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:25.474684 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:25.475112 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:25.546592 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:25.554173 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-58982c2d-d20a-45ca-a73d-e2fc53ee8805 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1210 microversion: 2.1 time: 0.095408 Oct 05 20:35:25.554772 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 614/1200] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:25 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:26.577650 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:26.578251 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:26.584603 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:26.585091 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:26.585542 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:26.586759 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:26.587214 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:26.587636 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:26.719005 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:26.727723 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-bb9f6cd5-a4f0-49fb-9aaf-dac80089ecff tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1266 microversion: 2.1 time: 0.153944 Oct 05 20:35:26.728523 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 587/1201] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:26 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:26.819130 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [req-0436b729-c674-4224-939d-28999b1babd9 req-f80dccd8-3dab-4fdc-8a89-e9e632e91b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad4710d-c07d-4e78-8d90-3023ae3149c3", "tag": "0f5039cf-6b79-4ac1-81a2-f922be04afa3"}]} {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:35:26.831028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0436b729-c674-4224-939d-28999b1babd9 req-f80dccd8-3dab-4fdc-8a89-e9e632e91b06 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:26.831805 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0436b729-c674-4224-939d-28999b1babd9 req-f80dccd8-3dab-4fdc-8a89-e9e632e91b06 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:26.832234 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [req-0436b729-c674-4224-939d-28999b1babd9 req-f80dccd8-3dab-4fdc-8a89-e9e632e91b06 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:26.844029 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.compute.server_external_events [req-0436b729-c674-4224-939d-28999b1babd9 req-f80dccd8-3dab-4fdc-8a89-e9e632e91b06 service nova] Creating event network-changed:0f5039cf-6b79-4ac1-81a2-f922be04afa3 for instance fad4710d-c07d-4e78-8d90-3023ae3149c3 on hv-cinder-80152 Oct 05 20:35:26.848938 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [req-0436b729-c674-4224-939d-28999b1babd9 req-f80dccd8-3dab-4fdc-8a89-e9e632e91b06 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033458 Oct 05 20:35:26.849726 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 615/1202] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:35:27.751961 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:27.752567 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:27.759583 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:27.760059 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:27.760488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:27.761207 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:27.761684 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:27.762102 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:27.895415 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:27.903206 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-0824bef8-cfa3-4ce0-b3e4-642ef7911970 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1266 microversion: 2.1 time: 0.155328 Oct 05 20:35:27.904172 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 588/1203] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:27 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:28.926165 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:28.926867 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:28.933088 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:28.933591 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:28.934028 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:28.934710 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:28.935171 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:28.935590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:29.069007 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:29.077431 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-5a297c9a-0fef-4db0-9a36-d2fa55e8348d tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1266 microversion: 2.1 time: 0.155915 Oct 05 20:35:29.078022 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 616/1204] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:28 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:30.100488 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:30.101140 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:30.107964 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:30.108450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:30.108892 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:30.109613 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:30.110075 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:30.110516 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:30.239795 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:30.247357 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-e8f67ca7-738e-4381-8597-b897b1998716 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1266 microversion: 2.1 time: 0.150760 Oct 05 20:35:30.247930 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 589/1205] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:30 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:31.269419 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:31.270058 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:31.276453 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:31.276936 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:31.277365 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:31.278084 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:31.278539 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:31.278962 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:31.418849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:31.423132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-870e227a-68d5-4c17-8b82-ee75f031f0e3 req-d97bd9e2-1ba4-4d29-9aca-2992ae2ad798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad4710d-c07d-4e78-8d90-3023ae3149c3", "name": "network-vif-plugged", "status": "completed", "tag": "0f5039cf-6b79-4ac1-81a2-f922be04afa3"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:35:31.427333 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9880f064-86c1-4cbe-a869-4168da31b706 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1266 microversion: 2.1 time: 0.161750 Oct 05 20:35:31.427989 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 617/1206] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:31 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:31.433813 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-870e227a-68d5-4c17-8b82-ee75f031f0e3 req-d97bd9e2-1ba4-4d29-9aca-2992ae2ad798 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:31.434401 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-870e227a-68d5-4c17-8b82-ee75f031f0e3 req-d97bd9e2-1ba4-4d29-9aca-2992ae2ad798 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:31.435132 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-870e227a-68d5-4c17-8b82-ee75f031f0e3 req-d97bd9e2-1ba4-4d29-9aca-2992ae2ad798 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:31.448133 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-870e227a-68d5-4c17-8b82-ee75f031f0e3 req-d97bd9e2-1ba4-4d29-9aca-2992ae2ad798 service nova] Creating event network-vif-plugged:0f5039cf-6b79-4ac1-81a2-f922be04afa3 for instance fad4710d-c07d-4e78-8d90-3023ae3149c3 on hv-cinder-80152 Oct 05 20:35:31.453323 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-870e227a-68d5-4c17-8b82-ee75f031f0e3 req-d97bd9e2-1ba4-4d29-9aca-2992ae2ad798 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033951 Oct 05 20:35:31.454020 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 590/1207] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:35:32.451051 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:32.451658 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:32.458080 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:32.458554 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:32.458982 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:32.459656 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:32.460103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:32.460519 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:32.592590 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:32.600244 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-9cec5f9b-c497-4730-a31f-6469880bf328 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1266 microversion: 2.1 time: 0.153103 Oct 05 20:35:32.600794 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 618/1208] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:32 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:33.624745 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:33.625444 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:33.631969 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:33.632445 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:33.632917 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:33.633665 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:33.634213 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:33.634638 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:33.766522 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:33.774128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-754fdec6-d411-4a95-b486-b67427905789 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1453 microversion: 2.1 time: 0.153964 Oct 05 20:35:33.774691 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 591/1209] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:33 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:33.796849 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:35:33.798049 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:35:33.800016 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=2 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:33.800840 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell0:SELECT=6 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:33.807310 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:33.807792 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:33.808224 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:33.808908 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:33.809363 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:33.809817 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:33.938150 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:35:33.946047 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-e061cc15-4b3b-4f63-b57d-fd70e7881878 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1453 microversion: 2.1 time: 0.153085 Oct 05 20:35:33.946614 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 619/1210] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:35:33 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:35:35.496028 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-9ef95129-5952-4380-8496-5c419b4feb03 req-d61a1336-f806-4738-970f-3d81f076056a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad4710d-c07d-4e78-8d90-3023ae3149c3", "tag": "0f5039cf-6b79-4ac1-81a2-f922be04afa3"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:35:35.500985 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell0:SELECT=2 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:35:35.507314 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-9ef95129-5952-4380-8496-5c419b4feb03 req-d61a1336-f806-4738-970f-3d81f076056a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:35:35.507797 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-9ef95129-5952-4380-8496-5c419b4feb03 req-d61a1336-f806-4738-970f-3d81f076056a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:35:35.508233 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-9ef95129-5952-4380-8496-5c419b4feb03 req-d61a1336-f806-4738-970f-3d81f076056a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:35:35.519855 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-9ef95129-5952-4380-8496-5c419b4feb03 req-d61a1336-f806-4738-970f-3d81f076056a service nova] Creating event network-changed:0f5039cf-6b79-4ac1-81a2-f922be04afa3 for instance fad4710d-c07d-4e78-8d90-3023ae3149c3 on hv-cinder-80152 Oct 05 20:35:35.524947 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-9ef95129-5952-4380-8496-5c419b4feb03 req-d61a1336-f806-4738-970f-3d81f076056a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033129 Oct 05 20:35:35.525557 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 592/1211] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:37:15.346948 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:15.347482 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_api:SELECT=16 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:37:15.347848 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:15.348166 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG dbcounter [-] [120350] Writing DB stats nova_cell1:SELECT=28 {{(pid=120350) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:37:15.349461 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 20:37:15.349811 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:37:15.349945 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Wed Oct 5 20:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 05 20:37:15.350568 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG dbcounter [-] [120351] Writing DB stats nova_cell1:SELECT=34 {{(pid=120351) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 20:37:15.352832 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 20:37:15.353281 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Wed Oct 5 20:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.23) !!! Oct 05 20:37:15.356515 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:15.357008 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:15.357439 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:15.358434 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:15.358887 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:15.359520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:15.366626 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-1b741514-1fc6-4097-ae21-b89164a416ec req-2684ca7a-46a2-4a84-8635-bb95a4e8bba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fad4710d-c07d-4e78-8d90-3023ae3149c3", "tag": "0f5039cf-6b79-4ac1-81a2-f922be04afa3"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:37:15.383777 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1b741514-1fc6-4097-ae21-b89164a416ec req-2684ca7a-46a2-4a84-8635-bb95a4e8bba5 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:15.384362 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1b741514-1fc6-4097-ae21-b89164a416ec req-2684ca7a-46a2-4a84-8635-bb95a4e8bba5 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:15.384887 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1b741514-1fc6-4097-ae21-b89164a416ec req-2684ca7a-46a2-4a84-8635-bb95a4e8bba5 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:15.387464 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:37:15.397128 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-1b741514-1fc6-4097-ae21-b89164a416ec req-2684ca7a-46a2-4a84-8635-bb95a4e8bba5 service nova] Creating event network-changed:0f5039cf-6b79-4ac1-81a2-f922be04afa3 for instance fad4710d-c07d-4e78-8d90-3023ae3149c3 on hv-cinder-80152 Oct 05 20:37:15.404943 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-1b741514-1fc6-4097-ae21-b89164a416ec req-2684ca7a-46a2-4a84-8635-bb95a4e8bba5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057806 Oct 05 20:37:15.405789 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 593/1212] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:37:15.476544 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-b7bd9a64-ed79-4df3-b621-734cb364509c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 204 len: 0 microversion: 2.1 time: 0.133976 Oct 05 20:37:15.477904 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 620/1213] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:37:15 2022] DELETE /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:37:15.486662 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:15.487355 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:15.493741 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:15.494532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:15.495958 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:15.497872 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:15.498580 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:15.499225 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:15.633116 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:37:15.641473 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6726d362-e9df-4bc6-a3f2-011f342211e4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1578 microversion: 2.1 time: 0.158998 Oct 05 20:37:15.642069 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 594/1214] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:15 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:37:16.666491 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:16.668570 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:16.675438 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:16.675919 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:16.676354 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:16.677037 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:16.677484 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:16.678001 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:16.850724 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:37:16.859103 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-98d6c043-299a-4f67-a7ae-b98062972203 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1578 microversion: 2.1 time: 0.196911 Oct 05 20:37:16.859668 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 621/1215] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:16 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1578 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:37:17.772707 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-1d1f1656-d045-45bb-ba55-28c539006294 req-2672717c-ebf4-4285-898c-6fdd14ac3957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fad4710d-c07d-4e78-8d90-3023ae3149c3", "name": "network-vif-deleted", "tag": "0f5039cf-6b79-4ac1-81a2-f922be04afa3"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:37:17.782446 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1d1f1656-d045-45bb-ba55-28c539006294 req-2672717c-ebf4-4285-898c-6fdd14ac3957 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:17.782923 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1d1f1656-d045-45bb-ba55-28c539006294 req-2672717c-ebf4-4285-898c-6fdd14ac3957 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:17.783352 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-1d1f1656-d045-45bb-ba55-28c539006294 req-2672717c-ebf4-4285-898c-6fdd14ac3957 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:17.794191 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-1d1f1656-d045-45bb-ba55-28c539006294 req-2672717c-ebf4-4285-898c-6fdd14ac3957 service nova] Creating event network-vif-deleted:0f5039cf-6b79-4ac1-81a2-f922be04afa3 for instance fad4710d-c07d-4e78-8d90-3023ae3149c3 on hv-cinder-80152 Oct 05 20:37:17.799268 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-1d1f1656-d045-45bb-ba55-28c539006294 req-2672717c-ebf4-4285-898c-6fdd14ac3957 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030236 Oct 05 20:37:17.799908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 595/1216] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:37:17.883152 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:17.883786 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:17.890876 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:17.891358 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:17.891796 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:17.892506 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:17.892959 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:17.893380 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:17.955822 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:37:17.963641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-14e738f2-8643-4050-aea0-c883e48aad79 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 200 len: 1225 microversion: 2.1 time: 0.084395 Oct 05 20:37:17.964209 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 622/1217] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:17 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:37:18.987315 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:18.988008 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: fad4710d-c07d-4e78-8d90-3023ae3149c3] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:18.994142 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:18.994620 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:18.995048 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:18.995732 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:18.996179 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:18.996614 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:19.009243 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] HTTP exception thrown: Instance fad4710d-c07d-4e78-8d90-3023ae3149c3 could not be found. Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Request method failure captured: Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 HTTP/1.1 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPemChnLZajzx9PjlBgyJBW0Zcdw9Sstp5Arhc7fMab9OZCUwHsG2Yq2dZyRaLc24_Pt-91L4bf7cn75EOA7cyRcqfMeJXQZAn1GXFDUYHD-lV1tXNZJwfibRIlEFLWyXLFGVChgBHCTZY36VbZhDsdIg0FsKsCTEj1RHTbL2ja1B6A0 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:37:19.010836 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3dae2633ff47484981df67d10b94de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3dae2633ff47484981df67d10b94de47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 7a5a70e8cad0452188dd1b750c4efa17 Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance fad4710d-c07d-4e78-8d90-3023ae3149c3 could not be found. Oct 05 20:37:19.013107 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': 'fad4710d-c07d-4e78-8d90-3023ae3149c3'} Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fad4710d-c07d-4e78-8d90-3023ae3149c3 could not be found. Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:37:19.014310 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fad4710d-c07d-4e78-8d90-3023ae3149c3 could not be found. Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fad4710d-c07d-4e78-8d90-3023ae3149c3 could not be found. Oct 05 20:37:19.016108 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:19.017646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Returning 404 to user: Instance fad4710d-c07d-4e78-8d90-3023ae3149c3 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:37:19.017646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-1f3fb2be-bac8-4a7c-a81d-5578c5b5c867 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3" status: 404 len: 111 microversion: 2.1 time: 0.030169 Oct 05 20:37:19.017646 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 596/1218] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:18 2022] GET /compute/v2.1/servers/fad4710d-c07d-4e78-8d90-3023ae3149c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:37:22.311955 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:22.312520 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:22.315223 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-52951e3a-6bf4-4bcc-99f7-60d6631f98fe req-41ece50e-e0a3-490c-92cf-3ab47cac11b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "334afcdf-49a7-4407-a4e5-6e08732c0f09", "tag": "5c8442c9-a216-465d-989a-71ac69a03040"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:37:22.319238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:22.319730 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:22.320311 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:22.321294 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:22.321807 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:22.322237 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:22.345384 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-52951e3a-6bf4-4bcc-99f7-60d6631f98fe req-41ece50e-e0a3-490c-92cf-3ab47cac11b8 service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:22.346002 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-52951e3a-6bf4-4bcc-99f7-60d6631f98fe req-41ece50e-e0a3-490c-92cf-3ab47cac11b8 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:22.349799 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-52951e3a-6bf4-4bcc-99f7-60d6631f98fe req-41ece50e-e0a3-490c-92cf-3ab47cac11b8 service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:22.352385 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Going to try to terminate instance {{(pid=120351) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 20:37:22.363181 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-52951e3a-6bf4-4bcc-99f7-60d6631f98fe req-41ece50e-e0a3-490c-92cf-3ab47cac11b8 service nova] Creating event network-changed:5c8442c9-a216-465d-989a-71ac69a03040 for instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 on hv-cinder-80152 Oct 05 20:37:22.369738 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-52951e3a-6bf4-4bcc-99f7-60d6631f98fe req-41ece50e-e0a3-490c-92cf-3ab47cac11b8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059190 Oct 05 20:37:22.370575 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 597/1219] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 20:37:22.459535 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f51e6dc3-ee3f-49e6-9041-0a847cdc2e05 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "DELETE /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 204 len: 0 microversion: 2.1 time: 0.152447 Oct 05 20:37:22.461549 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 623/1220] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:37:22 2022] DELETE /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 20:37:22.471395 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:22.472593 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:22.479838 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:22.481337 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:22.482187 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:22.483532 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:22.484193 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:22.484627 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:22.629177 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.policy [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120350) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:37:22.639100 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-6be60cb1-817e-46be-b19c-8bc167db96ee tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1577 microversion: 2.1 time: 0.172267 Oct 05 20:37:22.639908 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 598/1221] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:22 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:37:23.663359 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:23.664060 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:23.671009 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:23.671493 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:23.671928 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:23.672615 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:23.673068 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:23.673498 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:23.806202 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:37:23.813931 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-672e0f6f-4f73-4e56-9831-7eb65628dda8 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1577 microversion: 2.1 time: 0.154750 Oct 05 20:37:23.814500 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 624/1222] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:23 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:37:24.692644 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [req-490bbd6b-06da-439f-adf2-5f99894a460b req-80df094f-3726-413e-b1bb-687c76ca5a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "334afcdf-49a7-4407-a4e5-6e08732c0f09", "name": "network-vif-deleted", "tag": "5c8442c9-a216-465d-989a-71ac69a03040"}]} {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 20:37:24.704975 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-490bbd6b-06da-439f-adf2-5f99894a460b req-80df094f-3726-413e-b1bb-687c76ca5a9a service nova] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:24.705545 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-490bbd6b-06da-439f-adf2-5f99894a460b req-80df094f-3726-413e-b1bb-687c76ca5a9a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:24.706169 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [req-490bbd6b-06da-439f-adf2-5f99894a460b req-80df094f-3726-413e-b1bb-687c76ca5a9a service nova] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:24.718462 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.compute.server_external_events [req-490bbd6b-06da-439f-adf2-5f99894a460b req-80df094f-3726-413e-b1bb-687c76ca5a9a service nova] Creating event network-vif-deleted:5c8442c9-a216-465d-989a-71ac69a03040 for instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 on hv-cinder-80152 Oct 05 20:37:24.724302 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [req-490bbd6b-06da-439f-adf2-5f99894a460b req-80df094f-3726-413e-b1bb-687c76ca5a9a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035426 Oct 05 20:37:24.724895 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 599/1223] 10.222.0.23 () {64 vars in 1317 bytes} [Wed Oct 5 20:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 20:37:24.837304 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:24.837951 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:24.844238 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:24.844715 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:24.845154 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:24.845856 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:24.846303 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:24.846716 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:24.910481 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.policy [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a5a70e8cad0452188dd1b750c4efa17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dae2633ff47484981df67d10b94de47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120351) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 20:37:24.918641 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-f6b2765a-e91b-44e9-85f3-7c7ed957e168 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 200 len: 1226 microversion: 2.1 time: 0.085134 Oct 05 20:37:24.919198 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 625/1224] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:24 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 20:37:25.942664 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:25.943369 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 334afcdf-49a7-4407-a4e5-6e08732c0f09] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:25.950378 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:25.950861 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:25.951299 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:25.951994 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:25.952450 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:25.952877 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:25.966425 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] HTTP exception thrown: Instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 could not be found. Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Request method failure captured: Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 HTTP/1.1 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPemChnLZajzx9PjlBgyJBW0Zcdw9Sstp5Arhc7fMab9OZCUwHsG2Yq2dZyRaLc24_Pt-91L4bf7cn75EOA7cyRcqfMeJXQZAn1GXFDUYHD-lV1tXNZJwfibRIlEFLWyXLFGVChgBHCTZY36VbZhDsdIg0FsKsCTEj1RHTbL2ja1B6A0 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:37:25.968104 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3dae2633ff47484981df67d10b94de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3dae2633ff47484981df67d10b94de47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 7a5a70e8cad0452188dd1b750c4efa17 Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 could not be found. Oct 05 20:37:25.969910 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '334afcdf-49a7-4407-a4e5-6e08732c0f09'} Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 could not be found. Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:37:25.970951 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 could not be found. Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 could not be found. Oct 05 20:37:25.972625 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:25.974194 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Returning 404 to user: Instance 334afcdf-49a7-4407-a4e5-6e08732c0f09 could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:37:25.974194 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-ab0e0d0d-4c9b-43cb-a503-4e23c3a3034c tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09" status: 404 len: 111 microversion: 2.1 time: 0.031031 Oct 05 20:37:25.974194 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 600/1225] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:25 2022] GET /compute/v2.1/servers/334afcdf-49a7-4407-a4e5-6e08732c0f09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 20:37:26.401741 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:26.402260 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.compute.api [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120351) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:26.408886 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:26.409310 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:26.409793 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:26.410485 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:26.410941 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:26.411369 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG oslo_concurrency.lockutils [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120351) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:26.424816 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.wsgi [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] HTTP exception thrown: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Request method failure captured: Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: request: DELETE /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff HTTP/1.1 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept: application/json Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Accept-Encoding: identity Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Connection: close Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Length: 0 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Content-Type: application/json Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Host: 10.222.0.23 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: Openstack-System-Scope: None Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: User-Agent: python-urllib3/1.26.12 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Auth-Token: gAAAAABjPemChnLZajzx9PjlBgyJBW0Zcdw9Sstp5Arhc7fMab9OZCUwHsG2Yq2dZyRaLc24_Pt-91L4bf7cn75EOA7cyRcqfMeJXQZAn1GXFDUYHD-lV1tXNZJwfibRIlEFLWyXLFGVChgBHCTZY36VbZhDsdIg0FsKsCTEj1RHTbL2ja1B6A0 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Id: None Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Domain-Name: None Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Identity-Status: Confirmed Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Is-Admin-Project: True Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Id: default Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Domain-Name: Default Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Project-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Role: member,reader Oct 05 20:37:26.426488 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Roles: member,reader Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3dae2633ff47484981df67d10b94de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3dae2633ff47484981df67d10b94de47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-Tenant-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Id: default Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Domain-Name: Default Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Id: 7a5a70e8cad0452188dd1b750c4efa17 Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: X-User-Name: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: method: > Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: exception: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.428233 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: action_args: {'id': '4cfb4655-cc88-4186-90c6-5a2c9ef955ff'} Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:37:26.429211 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.430813 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.432408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Returning 404 to user: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. {{(pid=120351) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:37:26.432408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-c92c9360-d76d-4bb0-af6e-6740993b4097 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 404 len: 111 microversion: 2.1 time: 0.030210 Oct 05 20:37:26.432408 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 626/1226] 10.222.0.23 () {58 vars in 1239 bytes} [Wed Oct 5 20:37:26 2022] DELETE /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:37:26.436398 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '>' {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:26.437074 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.compute.api [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [instance: 4cfb4655-cc88-4186-90c6-5a2c9ef955ff] Fetching instance by UUID {{(pid=120350) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 20:37:26.442922 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:26.443404 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:26.443903 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:26.444617 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Acquiring lock "401763c2-8a97-48f5-b114-5efdfbd6245a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 20:37:26.445076 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 20:37:26.445786 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG oslo_concurrency.lockutils [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Lock "401763c2-8a97-48f5-b114-5efdfbd6245a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120350) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 20:37:26.458719 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.wsgi [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] HTTP exception thrown: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Request method failure captured: Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: request: GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff HTTP/1.1 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept: application/json Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Accept-Encoding: identity Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Connection: close Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Length: 0 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Content-Type: application/json Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Host: 10.222.0.23 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: Openstack-System-Scope: None Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: User-Agent: python-urllib3/1.26.12 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Auth-Token: gAAAAABjPemChnLZajzx9PjlBgyJBW0Zcdw9Sstp5Arhc7fMab9OZCUwHsG2Yq2dZyRaLc24_Pt-91L4bf7cn75EOA7cyRcqfMeJXQZAn1GXFDUYHD-lV1tXNZJwfibRIlEFLWyXLFGVChgBHCTZY36VbZhDsdIg0FsKsCTEj1RHTbL2ja1B6A0 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Id: None Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Domain-Name: None Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Identity-Status: Confirmed Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Is-Admin-Project: True Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Id: default Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Domain-Name: Default Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Project-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Role: member,reader Oct 05 20:37:26.460208 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Roles: member,reader Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.23:8080", "publicURL": "http://10.222.0.23:8080/v1/AUTH_3dae2633ff47484981df67d10b94de47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/compute/v2/3dae2633ff47484981df67d10b94de47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/volume/v3/3dae2633ff47484981df67d10b94de47"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.23/identity"}]}] Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Id: 3dae2633ff47484981df67d10b94de47 Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-Tenant-Name: tempest-TestVolumeBootPattern-1584484467 Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Id: default Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Domain-Name: Default Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Id: 7a5a70e8cad0452188dd1b750c4efa17 Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: X-User-Name: tempest-TestVolumeBootPattern-1584484467-project Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: method: > Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: exception: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.461816 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: action_args: {'id': '4cfb4655-cc88-4186-90c6-5a2c9ef955ff'} Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: {{(pid=120350) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 20:37:26.462643 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. Oct 05 20:37:26.464058 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: ERROR nova.api.openstack.wsgi Oct 05 20:37:26.465280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: DEBUG nova.api.openstack.wsgi [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Returning 404 to user: Instance 4cfb4655-cc88-4186-90c6-5a2c9ef955ff could not be found. {{(pid=120350) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 20:37:26.465280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: INFO nova.api.openstack.requestlog [None req-f5c3f1fc-bd45-45bd-a6f1-abefc031d4b7 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff" status: 404 len: 111 microversion: 2.1 time: 0.029097 Oct 05 20:37:26.465280 dv-cinder-801522-12-iscsi devstack@n-api.service[120350]: [pid: 120350|app: 0|req: 601/1227] 10.222.0.23 () {58 vars in 1236 bytes} [Wed Oct 5 20:37:26 2022] GET /compute/v2.1/servers/4cfb4655-cc88-4186-90c6-5a2c9ef955ff => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 20:37:27.750997 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: DEBUG nova.api.openstack.wsgi [None req-0dcc8487-4c2c-43ff-973e-1bcbfec358d4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] Calling method '.version_select at 0x7f3e05e2d0d0>' {{(pid=120351) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 20:37:27.755420 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0dcc8487-4c2c-43ff-973e-1bcbfec358d4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [ba8b1fc2-7269-48c7-b7d8-b25d234a99eb] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 20:37:28.762523 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO oslo.messaging._drivers.impl_rabbit [None req-0dcc8487-4c2c-43ff-973e-1bcbfec358d4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] [ba8b1fc2-7269-48c7-b7d8-b25d234a99eb] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 50348. Oct 05 20:37:28.783280 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: INFO nova.api.openstack.requestlog [None req-0dcc8487-4c2c-43ff-973e-1bcbfec358d4 tempest-TestVolumeBootPattern-1584484467 tempest-TestVolumeBootPattern-1584484467-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2076628725" status: 202 len: 0 microversion: 2.1 time: 1.036733 Oct 05 20:37:28.783865 dv-cinder-801522-12-iscsi devstack@n-api.service[120351]: [pid: 120351|app: 0|req: 627/1228] 10.222.0.23 () {58 vars in 1263 bytes} [Wed Oct 5 20:37:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2076628725 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)